2025-11-27 19:00:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-11-27 19:00:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-11-27 19:00:04 [astonbarclay.gb] INFO: Starting spider astonbarclay.gb
2025-11-27 19:00:04 [scrapy.addons] INFO: Enabled addons:
[]
2025-11-27 19:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2025-11-27 19:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-11-27 19:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-11-27 19:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: b4c49dc1e29c9fd8
2025-11-27 19:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-11-27 19:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/astonbarclay.gb/task_36_2025-11-27T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-11-27 19:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-11-27 19:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-11-27 19:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-11-27 19:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-11-27 19:00:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-11-27 19:00:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-11-27 19:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:04 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-11-27 19:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-11-27 19:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-11-27 19:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-11-27 19:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-11-27 19:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-11-27 19:00:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-11-27 19:00:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-11-27 19:00:04 [scrapy.core.engine] INFO: Spider opened
2025-11-27 19:00:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-11-27 19:00:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-11-27 19:00:04 [scrapy-playwright] INFO: Starting download handler
2025-11-27 19:00:04 [scrapy-playwright] INFO: Starting download handler
2025-11-27 19:00:09 [scrapy-playwright] INFO: Launching browser firefox
2025-11-27 19:00:10 [scrapy-playwright] INFO: Browser firefox launched
2025-11-27 19:00:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-11-27 19:00:10 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-11-27 19:00:10 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-11-27 19:00:11 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://catalogue.astonbarclay.net/vehicle-search>
2025-11-27 19:00:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-11-27 19:00:11 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/vehicle-search>
2025-11-27 19:00:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.googleapis.com/css?family=Lexend> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js>
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css>
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js>
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js>
2025-11-27 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.googleapis.com/css?family=Lexend>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://sessions.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/profileconfig> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf> (resource type: font, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/profileconfig>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/user> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/navigation> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/user>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/navigation>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js>
2025-11-27 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/facebook.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/facebook.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/twitter.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/twitter.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/sprite2.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/sprite2.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/vehicle/all> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2> (resource type: font, referrer: https://fonts.googleapis.com/)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js>
2025-11-27 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/vehicle/all>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-engine.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-engine.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-reg.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-reg.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-v5.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-v5.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mot.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mot.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-vat.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-vat.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/VN23WVS/2025-11-25/image/62601672-8933-4d86-a8f0-90ce9949e94a_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/VN23WVS/2025-11-25/image/62601672-8933-4d86-a8f0-90ce9949e94a_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/YB73NSN/2025-11-19/image/37560904-0693-431a-8be6-3f97dba2a861_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/YB73NSN/2025-11-19/image/37560904-0693-431a-8be6-3f97dba2a861_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SA71TNV/2025-11-13/image/4138c84a-08c7-4cd1-b9ce-e23fee231b17_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SA71TNV/2025-11-13/image/4138c84a-08c7-4cd1-b9ce-e23fee231b17_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SA16PVL/2025-11-26/image/b9624c94-aeb6-47ff-a7dc-a847fe316eb0_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SA16PVL/2025-11-26/image/b9624c94-aeb6-47ff-a7dc-a847fe316eb0_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/RO25DUH/2025-11-13/image/9ef7e07b-1537-41e5-8561-638fb674370b_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/RO25DUH/2025-11-13/image/9ef7e07b-1537-41e5-8561-638fb674370b_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/VK12SDZ/2025-11-13/image/f5fba0fe-cc4e-4d7b-aee2-d32cf7f95a7c_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/VK12SDZ/2025-11-13/image/f5fba0fe-cc4e-4d7b-aee2-d32cf7f95a7c_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LM73HXP/2025-11-13/image/1d0f9d00-c870-4633-bcbf-4cec5dd9a9b3_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LM73HXP/2025-11-13/image/1d0f9d00-c870-4633-bcbf-4cec5dd9a9b3_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/RF74FDM/2025-10-21/image/a5f3c5ca-ce14-44e7-9036-add97edd2549_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/RF74FDM/2025-10-21/image/a5f3c5ca-ce14-44e7-9036-add97edd2549_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/EJ62ABX/2025-11-19/image/c224c188-9b06-4e71-bd14-cb70a2021b75_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/EJ62ABX/2025-11-19/image/c224c188-9b06-4e71-bd14-cb70a2021b75_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/d977c5dd-ba3c-446a-bd23-1086871ce7c6_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/d977c5dd-ba3c-446a-bd23-1086871ce7c6_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/eb294593-6edc-4b32-8961-a6b97bdc8389_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/VN25ZXV/2025-10-23/image/eb294593-6edc-4b32-8961-a6b97bdc8389_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/DV74NXU/2025-11-27/image/19fd1cb2-9e77-4be4-a653-1e47ca1212da_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/DV74NXU/2025-11-27/image/19fd1cb2-9e77-4be4-a653-1e47ca1212da_removebg.jpg?w=600>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/image-unavailable.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/image-unavailable.png>
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <202 https://sessions.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/vehicle-search> (referer: None) ['playwright']
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [astonbarclay.gb] INFO: Cookies from Playwright: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Thu+Nov+27+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search', 'domain': '.astonbarclay.net', 'path': '/', 'expires': 1795806017, 'httpOnly': False, 'secure': False, 'sameSite': 'Lax'}]
2025-11-27 19:00:17 [astonbarclay.gb] INFO: Scrapy-formatted cookies: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Thu+Nov+27+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search', 'domain': '.astonbarclay.net', 'path': '/'}]
2025-11-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Adesa',RowKey='cookies') HTTP/1.1" 204 0
2025-11-27 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg>
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-11-27 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg>
2025-11-27 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-11-27 19:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/search?nonrunner=false&vehicletype=Car&agemax=9&mileagemax=320000> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117190866
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190866%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117190866: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117033189
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117033189%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117033189: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117407507
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407507%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117407507: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116931547
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116931547: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117082695
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117082695%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117082695: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116152685
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152685%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116152685: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116945130
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116945130%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116945130: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116496702
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116496702: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 115997019
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115997019%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 115997019: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116922516
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116922516%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116922516: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116016591
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116016591: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117048263
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117048263%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117048263: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116725518
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116725518%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116725518: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116930700
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116930700%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116930700: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117399393
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399393%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117399393: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116152721
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152721%27 HTTP/1.1" 200 None
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116152721: 0
2025-11-27 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117399936
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399936%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117399936: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116655276
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116655276%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116655276: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117099177
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099177%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117099177: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117433187
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433187%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117433187: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117431475
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431475%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117431475: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117288373
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288373%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117288373: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116136757
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116136757%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116136757: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117157384
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117157384%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117157384: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116954790
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116954790%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116954790: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117366645
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366645%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117366645: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117289497
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289497%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117289497: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117363536
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363536%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117363536: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116996626
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116996626%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116996626: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117381174
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381174%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117381174: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117344303
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344303%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117344303: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117362156
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362156%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117362156: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117548876
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548876%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117548876: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117214042
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214042%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117214042: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117403071
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403071%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117403071: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117492465
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492465%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117492465: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117523804
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523804%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117523804: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117399229
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399229%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117399229: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116560193
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116560193%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116560193: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117291740
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117291740%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117291740: 2
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116993535
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116993535%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116993535: 2
2025-11-27 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117121049
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121049%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117121049: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117241255
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117241255%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117241255: 2
2025-11-27 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117331639
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331639%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117331639: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117213849
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213849%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117213849: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116816864
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116816864%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116816864: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117364905
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364905%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117364905: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117085331
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085331%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117085331: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117222053
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117222053%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117222053: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117189494
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189494%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117189494: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117243520
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243520%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117243520: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117443109
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117443109%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117443109: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117442730
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442730%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117442730: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117240825
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240825%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117240825: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117442756
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442756%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117442756: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117442908
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442908%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117442908: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117443238
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117443238%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117443238: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117442530
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442530%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117442530: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117459298
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459298%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117459298: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117459589
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459589%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117459589: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117435069
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117435069%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117435069: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117439420
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117439420%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117439420: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117370985
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117370985%27 HTTP/1.1" 200 None
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117370985: 0
2025-11-27 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116950171
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116950171%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116950171: 2
2025-11-27 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117374089
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374089%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117374089: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117377391
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117377391%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117377391: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116983938
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116983938%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116983938: 2
2025-11-27 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117061695
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061695%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117061695: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117377467
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117377467%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117377467: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117183441
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183441%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117183441: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116751964
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116751964%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116751964: 2
2025-11-27 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116831775
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831775%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116831775: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116861086
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116861086%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116861086: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116947687
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116947687%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116947687: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116318543
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116318543%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116318543: 2
2025-11-27 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116699739
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699739%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116699739: 2
2025-11-27 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116699888
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699888%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116699888: 2
2025-11-27 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116897445
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116897445%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116897445: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116933624
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116933624%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116933624: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116809576
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116809576%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116809576: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116827121
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116827121%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116827121: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116914684
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116914684%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116914684: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117053521
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117053521%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117053521: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117015300
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015300%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117015300: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117099044
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099044%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117099044: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116982986
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116982986%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116982986: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117379276
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117379276%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117379276: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117210451
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117210451%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117210451: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116695109
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116695109%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116695109: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116832973
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832973%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116832973: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117458959
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458959%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117458959: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117025680
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117025680%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117025680: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117140367
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140367%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117140367: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117180057
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180057%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117180057: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117422663
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422663%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117422663: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117239410
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239410%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117239410: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116467871
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116467871%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116467871: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117456507
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117456507%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117456507: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116339169
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116339169%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116339169: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117358210
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117358210%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117358210: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117220810
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117220810%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117220810: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117182440
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117182440%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117182440: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117042418
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117042418%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117042418: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117343507
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117343507%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117343507: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116921234
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116921234%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116921234: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117007869
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117007869%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117007869: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117292195
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117292195%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117292195: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116809736
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116809736%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116809736: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117455163
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455163%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117455163: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117367177
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117367177%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117367177: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117180212
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180212%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117180212: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117215446
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215446%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117215446: 2
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116954039
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116954039%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116954039: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117019833
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019833%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117019833: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116955073
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116955073%27 HTTP/1.1" 200 None
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116955073: 0
2025-11-27 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117270782
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270782%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117270782: 2
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117054296
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117054296%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117054296: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116695131
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116695131%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116695131: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117427071
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427071%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117427071: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117219826
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117219826%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117219826: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116859096
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859096%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116859096: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117397553
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397553%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117397553: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117120733
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120733%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117120733: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116884737
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884737%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116884737: 2
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117291740?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116993535?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117241255?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117290098
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290098%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117290098: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117311401
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311401%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117311401: 2
2025-11-27 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117188811
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188811%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117188811: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116383281
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116383281%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116383281: 2
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116804824
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116804824%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116804824: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116765682
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116765682%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116765682: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117214087
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214087%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117214087: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117419692
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419692%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117419692: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116834410
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116834410%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116834410: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117006848
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117006848%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117006848: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117210160
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117210160%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117210160: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116999053
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116999053%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116999053: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117358738
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117358738%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117358738: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117054524
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117054524%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117054524: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117215585
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215585%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117215585: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117397422
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397422%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117397422: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117019889
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019889%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117019889: 2
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116950171?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116910715
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116910715%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116910715: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117148496
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117148496%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117148496: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117100799
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100799%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117100799: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117344093
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344093%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117344093: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116955214
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116955214%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116955214: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116910727
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116910727%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116910727: 0
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116832725
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832725%27 HTTP/1.1" 200 None
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116832725: 2
2025-11-27 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116699739?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116983938?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116751964?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116318543?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117291740, 'registration': 'AV65TSO', 'account': 'STE131', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Zetec 5dr', 'mileage': 42454, 'mileageWarranty': True, 'type': 'car', 'saleId': 17797, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-11-27T10:00Z', 'lot': 270, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-11-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV65TSO/2025-11-18/image/a3dddafa-a72e-46aa-9089-658baa04afc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/533a591b-e84c-4951-b5bb-e67e7be30baf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/a992217b-839d-4065-b7b1-91dfced9672d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/078c0d1d-c5d7-49a4-8a28-fdbe50467c79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/97ead7f4-4db1-4135-8d13-4cd1388aec36_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/3d816ba2-b6be-464d-9e9d-3ae388ece52f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/60f08ee6-4632-4f57-a2bf-ae5ef5e63b93_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/6288b7f8-52e1-4b1a-959f-25898e7af57b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/16-3k, 01/22-30k,', 'remarks': 'vosa states 16k, 28k, 29k, 30k, 33k, 36k, 41k,', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': 'TF', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc4905eb-81dc-4214-8f39-b5217d139cd3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117291740, 'registration': 'AV65TSO', 'account': 'STE131', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Zetec 5dr', 'mileage': 42454, 'mileageWarranty': True, 'type': 'car', 'saleId': 17797, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-11-27T10:00Z', 'lot': 270, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-11-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV65TSO/2025-11-18/image/a3dddafa-a72e-46aa-9089-658baa04afc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/533a591b-e84c-4951-b5bb-e67e7be30baf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/a992217b-839d-4065-b7b1-91dfced9672d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/078c0d1d-c5d7-49a4-8a28-fdbe50467c79_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/97ead7f4-4db1-4135-8d13-4cd1388aec36_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/3d816ba2-b6be-464d-9e9d-3ae388ece52f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/60f08ee6-4632-4f57-a2bf-ae5ef5e63b93_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV65TSO/2025-11-18/image/6288b7f8-52e1-4b1a-959f-25898e7af57b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/16-3k, 01/22-30k,', 'remarks': 'vosa states 16k, 28k, 29k, 30k, 33k, 36k, 41k,', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': 'TF', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc4905eb-81dc-4214-8f39-b5217d139cd3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce78161-d2fd-5e68-9968-a58f16827ec9 with identifier: 117291740
2025-11-27 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce78161-d2fd-5e68-9968-a58f16827ec9 with scrape type 2
2025-11-27 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ce78161-d2fd-5e68-9968-a58f16827ec9 with scrape type 2
2025-11-27 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7ce78161-d2fd-5e68-9968-a58f16827ec9, identifier: 117291740
2025-11-27 19:00:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116993535, 'registration': 'CV70KZR', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C5 AIRCROSS DIESEL HATCHBACK', 'derivative': '1.5 BlueHDi 130 Flair 5dr', 'mileage': 45138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17797, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-11-27T10:00Z', 'lot': 271, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-23', 'fuel': 'Diesel', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CV70KZR/2025-11-11/image/790d8409-2871-403f-8ced-c212e8aa6c22_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/c82bbcb0-732e-4842-b23c-d7855a38e95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/dbbcf756-3365-4716-824d-a65f1e5e1d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8930c21f-6a95-4934-bebf-880af9c7fdab_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/ecb0e0dc-9080-4b38-894a-1757cb3bcfb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8cccd87f-70f8-48e7-aa3a-bd722252fb31_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/cfe05a41-44b4-48b1-8ab8-4d98819b9417_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/40899db7-9ecf-4c71-ad15-ca84e34ba9b8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY VOSA STATES 33K 41K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bc3a9f8f-94b4-42cb-b492-163eaf6b8f1f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116993535, 'registration': 'CV70KZR', 'account': 'STE131', 'make': 'CITROEN', 'model': 'C5 AIRCROSS DIESEL HATCHBACK', 'derivative': '1.5 BlueHDi 130 Flair 5dr', 'mileage': 45138, 'mileageWarranty': True, 'type': 'car', 'saleId': 17797, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-11-27T10:00Z', 'lot': 271, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-23', 'fuel': 'Diesel', 'motExpiry': '2025-11-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CV70KZR/2025-11-11/image/790d8409-2871-403f-8ced-c212e8aa6c22_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/c82bbcb0-732e-4842-b23c-d7855a38e95e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/dbbcf756-3365-4716-824d-a65f1e5e1d9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8930c21f-6a95-4934-bebf-880af9c7fdab_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/ecb0e0dc-9080-4b38-894a-1757cb3bcfb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/8cccd87f-70f8-48e7-aa3a-bd722252fb31_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/cfe05a41-44b4-48b1-8ab8-4d98819b9417_removebg.jpg?w=600', 'https://abimg003.imgix.net/CV70KZR/2025-11-11/image/40899db7-9ecf-4c71-ad15-ca84e34ba9b8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY VOSA STATES 33K 41K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bc3a9f8f-94b4-42cb-b492-163eaf6b8f1f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with identifier: 116993535
2025-11-27 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f6841b3-4958-5fd8-a833-ab4d3383cdba with scrape type 2
2025-11-27 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f6841b3-4958-5fd8-a833-ab4d3383cdba with scrape type 2
2025-11-27 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6f6841b3-4958-5fd8-a833-ab4d3383cdba, identifier: 116993535
2025-11-27 19:00:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117241255, 'registration': 'RX16ZKP', 'account': 'THE109', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Signature Nav 5dr EDC', 'mileage': 105720, 'mileageWarranty': True, 'type': 'car', 'saleId': 17957, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-27T17:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2016-03-10', 'fuel': 'Diesel', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/1a78b4ca-d118-45fb-b0bc-00eac1c7c84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/28f395d2-0634-440f-a46e-c4563ef71297_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/a268c7f6-9a0b-4f08-886b-abebb3bf1b9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/e374b549-8306-4f36-afbc-42046b9dae49_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/a33f4778-14b3-47f3-ae6f-5e12ad4ab9a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/de554994-e8c6-44fd-83b3-49c9a413a898_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/aa4b2e15-0307-491f-9057-28d8c4218bfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/46845374-ea55-417b-a5b9-0ba450d09496_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/8483b3f1-7fc4-4138-ad06-e4609e66e57b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/669ad0e3-e63e-4305-a271-1e1888a7b2d4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/17-23K 02/20-52K 02/21-59K 02/22-69K 11/22-78K 12/23-90K 12/24-99K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 67K 78K 90K 99K', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c1f51bb1-f7f5-4242-98da-431816bcb0aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117241255, 'registration': 'RX16ZKP', 'account': 'THE109', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Signature Nav 5dr EDC', 'mileage': 105720, 'mileageWarranty': True, 'type': 'car', 'saleId': 17957, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-27T17:00Z', 'lot': None, 'hall': 'Virtual', 'transmission': 'automatic', 'firstRegistration': '2016-03-10', 'fuel': 'Diesel', 'motExpiry': '2025-12-21', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/1a78b4ca-d118-45fb-b0bc-00eac1c7c84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/28f395d2-0634-440f-a46e-c4563ef71297_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/a268c7f6-9a0b-4f08-886b-abebb3bf1b9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/e374b549-8306-4f36-afbc-42046b9dae49_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/a33f4778-14b3-47f3-ae6f-5e12ad4ab9a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/de554994-e8c6-44fd-83b3-49c9a413a898_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/aa4b2e15-0307-491f-9057-28d8c4218bfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/46845374-ea55-417b-a5b9-0ba450d09496_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/8483b3f1-7fc4-4138-ad06-e4609e66e57b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX16ZKP/2025-11-18/image/669ad0e3-e63e-4305-a271-1e1888a7b2d4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/17-23K 02/20-52K 02/21-59K 02/22-69K 11/22-78K 12/23-90K 12/24-99K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 67K 78K 90K 99K', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c1f51bb1-f7f5-4242-98da-431816bcb0aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b318104a-187c-5751-ab2f-804c6fd93768 with identifier: 117241255
2025-11-27 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b318104a-187c-5751-ab2f-804c6fd93768 with scrape type 2
2025-11-27 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b318104a-187c-5751-ab2f-804c6fd93768 with scrape type 2
2025-11-27 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b318104a-187c-5751-ab2f-804c6fd93768, identifier: 117241255
2025-11-27 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117320089
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117320089%27 HTTP/1.1" 200 None
2025-11-27 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117320089: 2
2025-11-27 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7ce78161-d2fd-5e68-9968-a58f16827ec9 with identifier: 117291740
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-11-27 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-11-27 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7ce78161-d2fd-5e68-9968-a58f16827ec9 with identifier: 117291740
2025-11-27 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 7ce78161-d2fd-5e68-9968-a58f16827ec9 with expiration date: 2025-11-27T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-27T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7ce78161-d2fd-5e68-9968-a58f16827ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AV65TSO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117291740',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 42454,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-27',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Zetec 5dr',
 'vin': None,
 'year': 2015}
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117291740%27 HTTP/1.1" 200 None
2025-11-27 19:00:23 [astonbarclay.gb] INFO: Saving data for 117291740: {'auction_closing_time': 1764237600.0, 'created_time': 1763492819.342325, 'last_price_update_time': 1764270023.714216}
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117291740') HTTP/1.1" 204 0
2025-11-27 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with identifier: 116993535
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-11-27 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with identifier: 116993535
2025-11-27 19:00:24 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 6f6841b3-4958-5fd8-a833-ab4d3383cdba with expiration date: 2025-11-27T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-27T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6f6841b3-4958-5fd8-a833-ab4d3383cdba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CV70KZR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116993535',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'CITROEN',
 'model': 'C5 AIRCROSS DIESEL HATCHBACK',
 'odometer': 45138,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'CITROEN C5 AIRCROSS DIESEL HATCHBACK 1.5 BlueHDi 130 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 130 Flair 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116993535%27 HTTP/1.1" 200 None
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Saving data for 116993535: {'auction_closing_time': 1764237600.0, 'created_time': 1762801358.374467, 'last_price_update_time': 1764270024.269745}
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116993535') HTTP/1.1" 204 0
2025-11-27 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b318104a-187c-5751-ab2f-804c6fd93768 with identifier: 117241255
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-11-27 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b318104a-187c-5751-ab2f-804c6fd93768 with identifier: 117241255
2025-11-27 19:00:24 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: b318104a-187c-5751-ab2f-804c6fd93768 with expiration date: 2025-11-27T17:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-27T17:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b318104a-187c-5751-ab2f-804c6fd93768',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RX16ZKP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117241255',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'RENAULT',
 'model': 'KADJAR DIESEL HATCHBACK',
 'odometer': 105720,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-10',
 'seller_name': 'TCB Group - Prime',
 'title': 'RENAULT KADJAR DIESEL HATCHBACK 1.5 dCi Signature Nav 5dr EDC',
 'transmission': 'automatic',
 'trim': '1.5 dCi Signature Nav 5dr EDC',
 'vin': None,
 'year': 2016}
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117241255%27 HTTP/1.1" 200 None
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Saving data for 117241255: {'auction_closing_time': 1764262800.0, 'created_time': 1763406090.896516, 'last_price_update_time': 1764270024.506694}
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117241255') HTTP/1.1" 204 0
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116950171, 'registration': 'PJ74RSY', 'account': 'VAN052', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 115 Match 5dr DSG', 'mileage': 2109, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 19, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/44250e2c-958f-48c4-bf74-01a00883d9a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/2c74946d-2593-473d-a3e2-f2dc3c1a1855_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/35b1d925-e482-4866-85b4-a131dcf47c9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/0a292a59-1661-44d3-a8e9-8fd3cab0f16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/ab0b8d9c-15ac-4f3b-9ece-6a4c16e4ebb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/bcddabfa-cc49-4996-b67c-7e545d64441f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/42aeb357-d086-4b19-8d38-fdfa0c107671_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/8ddaa3b1-ac12-4015-9813-a9de62684817_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/9888ea49-b897-40f6-b51e-98512a1f2695_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1276**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0f6fa71-05fa-4412-b3f8-7ac1d82a18c5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116950171, 'registration': 'PJ74RSY', 'account': 'VAN052', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 115 Match 5dr DSG', 'mileage': 2109, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 19, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-01-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/44250e2c-958f-48c4-bf74-01a00883d9a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/2c74946d-2593-473d-a3e2-f2dc3c1a1855_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/35b1d925-e482-4866-85b4-a131dcf47c9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/0a292a59-1661-44d3-a8e9-8fd3cab0f16d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/ab0b8d9c-15ac-4f3b-9ece-6a4c16e4ebb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/bcddabfa-cc49-4996-b67c-7e545d64441f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/42aeb357-d086-4b19-8d38-fdfa0c107671_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/8ddaa3b1-ac12-4015-9813-a9de62684817_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ74RSY/2025-11-07/image/9888ea49-b897-40f6-b51e-98512a1f2695_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1276**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0f6fa71-05fa-4412-b3f8-7ac1d82a18c5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5419bf88-dadf-5284-8148-ce70e59a9ae8 with identifier: 116950171
2025-11-27 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5419bf88-dadf-5284-8148-ce70e59a9ae8 with scrape type 2
2025-11-27 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5419bf88-dadf-5284-8148-ce70e59a9ae8 with scrape type 2
2025-11-27 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5419bf88-dadf-5284-8148-ce70e59a9ae8, identifier: 116950171
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117457018
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457018%27 HTTP/1.1" 200 None
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117457018: 0
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117074537
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117074537%27 HTTP/1.1" 200 None
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117074537: 0
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117112542
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117112542%27 HTTP/1.1" 200 None
2025-11-27 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117112542: 2
2025-11-27 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5419bf88-dadf-5284-8148-ce70e59a9ae8 with identifier: 116950171
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-11-27 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5419bf88-dadf-5284-8148-ce70e59a9ae8 with identifier: 116950171
2025-11-27 19:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5419bf88-dadf-5284-8148-ce70e59a9ae8 with identifier: 116950171 to the API
2025-11-27 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275419bf88-dadf-5284-8148-ce70e59a9ae8%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5419bf88-dadf-5284-8148-ce70e59a9ae8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:25 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116950171?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '5419bf88-dadf-5284-8148-ce70e59a9ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PJ74RSY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116950171',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS ESTATE',
 'odometer': 2109,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-03',
 'seller_name': 'Vantage Motor Group',
 'title': 'VOLKSWAGEN T-CROSS ESTATE 1.0 TSI 115 Match 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 115 Match 5dr DSG',
 'vin': None,
 'year': 2025}
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116950171%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Saving data for 116950171: {'auction_closing_time': 1764323100.0, 'created_time': 1762455730.401319, 'last_price_update_time': 1764270026.033952}
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116950171') HTTP/1.1" 204 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116699739, 'registration': 'RE22UCM', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 33471, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 31, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-04-03', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f7a81ad1-19a7-4c2b-a26d-70c5a93dbf16_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/c351beb1-21fd-462f-a072-1f84c9bfb965_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/6b996730-6c5c-4e01-b5e4-7d94a44369ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/bb9bf7b7-edc4-4a14-92a3-fd55c942eb30_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/d2fb3376-6382-4e1d-a16c-7b36320473e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f1bd2660-aec5-4d87-a38c-cb64244885b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/7e712e7b-3cda-4ebd-b53e-af0d5da572fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f5d42b5b-5135-48da-8fd2-4679f6e94f9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/9998987d-ad40-490f-8834-255948c12c48_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**282**SPARE KEY / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eba9cff5-6fbc-497d-8b18-a07213bde2a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116699739, 'registration': 'RE22UCM', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 33471, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 31, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-04-03', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f7a81ad1-19a7-4c2b-a26d-70c5a93dbf16_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/c351beb1-21fd-462f-a072-1f84c9bfb965_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/6b996730-6c5c-4e01-b5e4-7d94a44369ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/bb9bf7b7-edc4-4a14-92a3-fd55c942eb30_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/d2fb3376-6382-4e1d-a16c-7b36320473e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f1bd2660-aec5-4d87-a38c-cb64244885b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/7e712e7b-3cda-4ebd-b53e-af0d5da572fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/f5d42b5b-5135-48da-8fd2-4679f6e94f9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UCM/2025-11-27/image/9998987d-ad40-490f-8834-255948c12c48_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**282**SPARE KEY / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eba9cff5-6fbc-497d-8b18-a07213bde2a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739
2025-11-27 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b0bf54-378a-5e7c-863f-8cd92e109515 with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b0bf54-378a-5e7c-863f-8cd92e109515 with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 63b0bf54-378a-5e7c-863f-8cd92e109515, identifier: 116699739
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116983938, 'registration': 'PJ73TWG', 'account': 'VAN061', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 10213, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 22, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/17b92e0f-ac1a-476f-b1e2-2f6ff55341c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/d0f34a86-8fb9-4696-8591-4775e75edf3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/e30de72d-bc25-4760-8a54-cd59311ea467_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/afb02428-ef52-4054-a72d-85b80318b8a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/65994e9a-4f46-4ab4-9d9b-2465ceef9671_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/0879a662-86e5-4baf-b4eb-c308b73d56f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/a1fb1be7-32dc-4eb6-a0fb-a1c7d0e57f5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/1fc0d3b5-706c-4b52-8c9b-72e6eba81d28_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/6a8956ad-d21c-4727-80af-ec8ef1fe7ce3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/24 - 4K, 09/25 - 9K', 'remarks': '**1298**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfab9572-9b77-4f97-bad0-7170f67fb01c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116983938, 'registration': 'PJ73TWG', 'account': 'VAN061', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 10213, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 22, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/17b92e0f-ac1a-476f-b1e2-2f6ff55341c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/d0f34a86-8fb9-4696-8591-4775e75edf3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/e30de72d-bc25-4760-8a54-cd59311ea467_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/afb02428-ef52-4054-a72d-85b80318b8a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/65994e9a-4f46-4ab4-9d9b-2465ceef9671_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/0879a662-86e5-4baf-b4eb-c308b73d56f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/a1fb1be7-32dc-4eb6-a0fb-a1c7d0e57f5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/1fc0d3b5-706c-4b52-8c9b-72e6eba81d28_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ73TWG/2025-11-27/image/6a8956ad-d21c-4727-80af-ec8ef1fe7ce3_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/24 - 4K, 09/25 - 9K', 'remarks': '**1298**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cfab9572-9b77-4f97-bad0-7170f67fb01c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938
2025-11-27 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55728a6-465d-5b65-b9bc-367c9025520f with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55728a6-465d-5b65-b9bc-367c9025520f with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e55728a6-465d-5b65-b9bc-367c9025520f, identifier: 116983938
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116751964, 'registration': 'RE22UMA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Life 5dr', 'mileage': 35629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 26, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Petrol', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UMA/2025-10-29/image/9abeff64-cd1b-40f0-a8ab-561d8c5f71ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/2c8aacc3-4d9f-413f-bc86-050d5d759120_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/42ad67ae-61ce-45f8-919c-780f94dbbec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/359721c6-30b9-46e3-a0e9-8536a1f75754_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/62143450-bd68-4eae-812d-00d2bf6cbecd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/fdc09a24-a4fa-4320-b478-d033d8a28c7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/a0c1a1fb-4ad2-40e1-9185-a4f64af7235b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/8eaa241d-10a0-4de1-bd77-22823ea0b9fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/c85a36a1-6e97-45ac-bdb2-d3d1e2bbbd2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/73f091ca-fd62-4c09-ab63-b1cbfe465b6a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**246**VOSA STATES 30K,  SPARE KEY - / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd99b74d-3172-449e-b2f2-c96ba9faf27b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116751964, 'registration': 'RE22UMA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Life 5dr', 'mileage': 35629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 26, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Petrol', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UMA/2025-10-29/image/9abeff64-cd1b-40f0-a8ab-561d8c5f71ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/2c8aacc3-4d9f-413f-bc86-050d5d759120_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/42ad67ae-61ce-45f8-919c-780f94dbbec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/359721c6-30b9-46e3-a0e9-8536a1f75754_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/62143450-bd68-4eae-812d-00d2bf6cbecd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/fdc09a24-a4fa-4320-b478-d033d8a28c7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/a0c1a1fb-4ad2-40e1-9185-a4f64af7235b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/8eaa241d-10a0-4de1-bd77-22823ea0b9fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/c85a36a1-6e97-45ac-bdb2-d3d1e2bbbd2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMA/2025-10-29/image/73f091ca-fd62-4c09-ab63-b1cbfe465b6a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**246**VOSA STATES 30K,  SPARE KEY - / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd99b74d-3172-449e-b2f2-c96ba9faf27b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85fdb911-0541-591c-8280-0688fbbd69ac with identifier: 116751964
2025-11-27 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85fdb911-0541-591c-8280-0688fbbd69ac with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85fdb911-0541-591c-8280-0688fbbd69ac with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 85fdb911-0541-591c-8280-0688fbbd69ac, identifier: 116751964
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116318543, 'registration': 'BK71XRH', 'account': 'KIN032', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e S 5dr Auto', 'mileage': 24800, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 30, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK71XRH/2025-10-16/image/6e345a6a-f8fe-4232-8769-2268a539bf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/9b972302-9fdc-4233-b8c2-f5c28d9ba1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5d91d165-89ab-43d4-acd8-2df0fb5b69c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/cdabd089-317a-46ae-9551-4c870a4084f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5f74e780-b23c-4eb3-93f6-462118d94870_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/72e4118c-710e-4be3-975b-16c6b249a7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/3f887210-fffb-4cc4-b955-c7e2352fee36_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/8d61ee93-a7af-48e2-8e4c-8d9989ddf650_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/296037b3-0bbe-4483-b5fb-2801b530bfa2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**314** VOSA STATES 18K, 23K, SPARE KEY  CHARGING  CABLE / 18" 5 split spoke gloss sparkle silver alloy wheels - Style 5075 / Grained leather - Ebony, Ebony/Ebony color way', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/078d963a-ff45-48f2-aab7-3235c2991db4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116318543, 'registration': 'BK71XRH', 'account': 'KIN032', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE HATCHBACK', 'derivative': '1.5 P300e S 5dr Auto', 'mileage': 24800, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 30, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-01', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BK71XRH/2025-10-16/image/6e345a6a-f8fe-4232-8769-2268a539bf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/9b972302-9fdc-4233-b8c2-f5c28d9ba1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5d91d165-89ab-43d4-acd8-2df0fb5b69c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/cdabd089-317a-46ae-9551-4c870a4084f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/5f74e780-b23c-4eb3-93f6-462118d94870_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/72e4118c-710e-4be3-975b-16c6b249a7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/3f887210-fffb-4cc4-b955-c7e2352fee36_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/8d61ee93-a7af-48e2-8e4c-8d9989ddf650_removebg.jpg?w=600', 'https://abimg003.imgix.net/BK71XRH/2025-10-16/image/296037b3-0bbe-4483-b5fb-2801b530bfa2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**314** VOSA STATES 18K, 23K, SPARE KEY  CHARGING  CABLE / 18" 5 split spoke gloss sparkle silver alloy wheels - Style 5075 / Grained leather - Ebony, Ebony/Ebony color way', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/078d963a-ff45-48f2-aab7-3235c2991db4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543
2025-11-27 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60972877-f070-5940-a80e-d52ff5e981bb with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60972877-f070-5940-a80e-d52ff5e981bb with scrape type 2
2025-11-27 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60972877-f070-5940-a80e-d52ff5e981bb, identifier: 116318543
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117486532
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117486532%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117486532: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117476696
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117476696%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117476696: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117456568
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117456568%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117456568: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117074549
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117074549%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117074549: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117261074
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117261074%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117261074: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117400223
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400223%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117400223: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117274004
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274004%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117274004: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117120537
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120537%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117120537: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117290656
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290656%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117290656: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117007884
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117007884%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117007884: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117240084
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240084%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117240084: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117458877
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458877%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117458877: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116838809
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116838809%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116838809: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117399333
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399333%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117399333: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117326826
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117326826%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117326826: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117188630
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188630%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117188630: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117056489
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056489%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117056489: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116767158
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116767158%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116767158: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117341166
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117341166%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117341166: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117443782
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117443782%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117443782: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117278304
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117278304%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117278304: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117072173
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117072173%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117072173: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117341188
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117341188%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117341188: 0
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117274456
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274456%27 HTTP/1.1" 200 None
2025-11-27 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117274456: 1
2025-11-27 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-11-27 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739
2025-11-27 19:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 63b0bf54-378a-5e7c-863f-8cd92e109515 with identifier: 116699739 to the API
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116699739?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '63b0bf54-378a-5e7c-863f-8cd92e109515',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22UCM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699739',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 33471,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699739%27 HTTP/1.1" 200 None
2025-11-27 19:00:27 [astonbarclay.gb] INFO: Saving data for 116699739: {'auction_closing_time': 1764323100.0, 'created_time': 1762284213.54789, 'last_price_update_time': 1764270027.407552}
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116699739') HTTP/1.1" 204 0
2025-11-27 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric+Hybrid HTTP/1.1" 200 None
2025-11-27 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938
2025-11-27 19:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e55728a6-465d-5b65-b9bc-367c9025520f with identifier: 116983938 to the API
2025-11-27 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e55728a6-465d-5b65-b9bc-367c9025520f%27 HTTP/1.1" 200 None
2025-11-27 19:00:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e55728a6-465d-5b65-b9bc-367c9025520f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116983938?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'e55728a6-465d-5b65-b9bc-367c9025520f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PJ73TWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116983938',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 10213,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-21',
 'seller_name': 'Vantage Motor Group',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power Tekna 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power Tekna 5dr Auto',
 'vin': None,
 'year': 2023}
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116983938%27 HTTP/1.1" 200 None
2025-11-27 19:00:28 [astonbarclay.gb] INFO: Saving data for 116983938: {'auction_closing_time': 1764323100.0, 'created_time': 1762455738.268894, 'last_price_update_time': 1764270028.497578}
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116983938') HTTP/1.1" 204 0
2025-11-27 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 85fdb911-0541-591c-8280-0688fbbd69ac with identifier: 116751964
2025-11-27 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 85fdb911-0541-591c-8280-0688fbbd69ac with identifier: 116751964
2025-11-27 19:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 85fdb911-0541-591c-8280-0688fbbd69ac with identifier: 116751964 to the API
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116751964?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '85fdb911-0541-591c-8280-0688fbbd69ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22UMA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116751964',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 35629,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Life 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116751964%27 HTTP/1.1" 200 None
2025-11-27 19:00:28 [astonbarclay.gb] INFO: Saving data for 116751964: {'auction_closing_time': 1764323100.0, 'created_time': 1762542260.897298, 'last_price_update_time': 1764270028.788682}
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116751964') HTTP/1.1" 204 0
2025-11-27 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FPlugin+Electric+Hybrid HTTP/1.1" 200 None
2025-11-27 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543
2025-11-27 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60972877-f070-5940-a80e-d52ff5e981bb with identifier: 116318543 to the API
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116318543?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '60972877-f070-5940-a80e-d52ff5e981bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BK71XRH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116318543',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE HATCHBACK',
 'odometer': 24800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-01',
 'seller_name': 'Kinto',
 'title': 'LAND ROVER RANGE ROVER EVOQUE HATCHBACK 1.5 P300e S 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 P300e S 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116318543%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Saving data for 116318543: {'auction_closing_time': 1764323100.0, 'created_time': 1761160108.046799, 'last_price_update_time': 1764270029.315214}
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116318543') HTTP/1.1" 204 0
2025-11-27 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116933624?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116914684?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117372675
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372675%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117372675: 1
2025-11-27 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116699888?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117405738
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405738%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117405738: 1
2025-11-27 19:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 116824054
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116824054%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Scrape type for 116824054: 1
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117209835
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209835%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117209835: 1
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117355965
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117355965%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117355965: 1
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117260206
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260206%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117260206: 1
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116933624, 'registration': 'DK71FZU', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV Vignale 5dr CVT', 'mileage': 50960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 34, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-08', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DK71FZU/2025-11-04/image/8d1ea1aa-ba03-4204-a787-118dcc6f3dde_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/947895aa-449f-4b5d-90e1-b50d1dbc7e56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/55544a2f-5ba7-4775-917d-085ddbc87a8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/f02a8f5a-0e95-4725-a7aa-787a698c4ba0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/17b6a6c6-e3cb-4e33-8005-089cead0839d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/fae9bd84-fee2-40e8-bfce-26c220dbbdfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/7c26d3c7-0086-40b5-8510-dc649f0c4c9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/6ca3e869-de34-455c-8a27-c69617a975d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/2b7d990c-9032-440f-ac23-32e365f22f34_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22-23K, 10/23-37K,', 'remarks': '**1104** VOSA STATES 50K, 50K,  CHARGING CABLE - / Windsor Leather - Charcoal black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c6559293-2a5c-459a-8a11-484a3dd60665.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116933624, 'registration': 'DK71FZU', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV Vignale 5dr CVT', 'mileage': 50960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 34, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-08', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DK71FZU/2025-11-04/image/8d1ea1aa-ba03-4204-a787-118dcc6f3dde_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/947895aa-449f-4b5d-90e1-b50d1dbc7e56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/55544a2f-5ba7-4775-917d-085ddbc87a8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/f02a8f5a-0e95-4725-a7aa-787a698c4ba0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/17b6a6c6-e3cb-4e33-8005-089cead0839d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/fae9bd84-fee2-40e8-bfce-26c220dbbdfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/7c26d3c7-0086-40b5-8510-dc649f0c4c9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/6ca3e869-de34-455c-8a27-c69617a975d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK71FZU/2025-11-04/image/2b7d990c-9032-440f-ac23-32e365f22f34_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22-23K, 10/23-37K,', 'remarks': '**1104** VOSA STATES 50K, 50K,  CHARGING CABLE - / Windsor Leather - Charcoal black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 32, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c6559293-2a5c-459a-8a11-484a3dd60665.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5125597-8402-5fb2-9a73-e11c4d8c9699 with identifier: 116933624
2025-11-27 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5125597-8402-5fb2-9a73-e11c4d8c9699 with scrape type 2
2025-11-27 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5125597-8402-5fb2-9a73-e11c4d8c9699 with scrape type 2
2025-11-27 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c5125597-8402-5fb2-9a73-e11c4d8c9699, identifier: 116933624
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116914684, 'registration': 'RE22DFA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 38212, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 37, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-12', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22DFA/2025-11-27/image/a57b5c30-e306-4470-9621-7b348218af13_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/957e5d95-7a1c-49e2-8289-b74704c463ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f11ce8c2-1361-42c5-b2d2-27c5d913a683_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/b664670c-bb49-434b-982a-8531ae3ca926_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/e48459ff-cfa0-40b9-b813-10589b75d9ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/669ef9f4-41b0-4c82-99c7-c07d23aa59a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f625b9a3-5b2f-44e6-aa8b-f58c09287490_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/172d3fd6-1756-45f8-859f-15f6eccdd08f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/fcb6e96f-d6df-45b7-a0d3-b43759327331_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**245**VOSA STATES 33K  SPARE KEY - / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01e8b16e-016f-41c9-b656-1b86ebb54e2f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116914684, 'registration': 'RE22DFA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 38212, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 37, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-12', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22DFA/2025-11-27/image/a57b5c30-e306-4470-9621-7b348218af13_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/957e5d95-7a1c-49e2-8289-b74704c463ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f11ce8c2-1361-42c5-b2d2-27c5d913a683_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/b664670c-bb49-434b-982a-8531ae3ca926_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/e48459ff-cfa0-40b9-b813-10589b75d9ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/669ef9f4-41b0-4c82-99c7-c07d23aa59a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/f625b9a3-5b2f-44e6-aa8b-f58c09287490_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/172d3fd6-1756-45f8-859f-15f6eccdd08f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22DFA/2025-11-27/image/fcb6e96f-d6df-45b7-a0d3-b43759327331_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**245**VOSA STATES 33K  SPARE KEY - / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01e8b16e-016f-41c9-b656-1b86ebb54e2f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684
2025-11-27 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with scrape type 2
2025-11-27 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with scrape type 2
2025-11-27 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43, identifier: 116914684
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117521004
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117521004%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117521004: 1
2025-11-27 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c5125597-8402-5fb2-9a73-e11c4d8c9699 with identifier: 116933624
2025-11-27 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c5125597-8402-5fb2-9a73-e11c4d8c9699 with identifier: 116933624
2025-11-27 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c5125597-8402-5fb2-9a73-e11c4d8c9699 with identifier: 116933624 to the API
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116933624?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'c5125597-8402-5fb2-9a73-e11c4d8c9699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DK71FZU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116933624',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 50960,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seller_name': 'Kinto',
 'title': 'FORD KUGA ESTATE 2.5 PHEV Vignale 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 PHEV Vignale 5dr CVT',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116933624%27 HTTP/1.1" 200 None
2025-11-27 19:00:29 [astonbarclay.gb] INFO: Saving data for 116933624: {'auction_closing_time': 1764323100.0, 'created_time': 1762542246.050237, 'last_price_update_time': 1764270029.960779}
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116933624') HTTP/1.1" 204 0
2025-11-27 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684
2025-11-27 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684
2025-11-27 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7fad7b0a-8338-5d85-9ce6-cf257ecafd43 with identifier: 116914684 to the API
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116914684?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '7fad7b0a-8338-5d85-9ce6-cf257ecafd43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22DFA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116914684',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 38212,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-12',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116914684%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Saving data for 116914684: {'auction_closing_time': 1764323100.0, 'created_time': 1762974213.491158, 'last_price_update_time': 1764270030.295337}
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116914684') HTTP/1.1" 204 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116699888, 'registration': 'RE22WNP', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 32940, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 32, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22WNP/2025-10-28/image/916007dd-be17-4493-b2f5-3c115711448e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/0b075fd3-3bb0-467d-842a-f77b7a316ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/d91d1c50-02db-4852-88e4-3b598f171096_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/726119c3-b5dd-4b6e-bd1f-297f3d5c0548_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/8e640a76-e20c-44a4-8cc4-588fa346d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/b5c08a57-84df-4bf1-abef-dbc0fa711a6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/4f16066a-3990-48e0-947a-cbe1878043c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/5dae9e3d-13ef-45d7-b566-a36f6a843814_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/f0049c9c-2616-4a2a-a094-47232b784ea7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**224**VOSA STATES 29K  SPARE KEY  / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b823f515-24b7-40c5-9a25-0f11c300ca24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116699888, 'registration': 'RE22WNP', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 32940, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 32, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22WNP/2025-10-28/image/916007dd-be17-4493-b2f5-3c115711448e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/0b075fd3-3bb0-467d-842a-f77b7a316ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/d91d1c50-02db-4852-88e4-3b598f171096_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/726119c3-b5dd-4b6e-bd1f-297f3d5c0548_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/8e640a76-e20c-44a4-8cc4-588fa346d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/b5c08a57-84df-4bf1-abef-dbc0fa711a6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/4f16066a-3990-48e0-947a-cbe1878043c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/5dae9e3d-13ef-45d7-b566-a36f6a843814_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22WNP/2025-10-28/image/f0049c9c-2616-4a2a-a094-47232b784ea7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**224**VOSA STATES 29K  SPARE KEY  / Maze cloth - Soul', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b823f515-24b7-40c5-9a25-0f11c300ca24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888
2025-11-27 19:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with scrape type 2
2025-11-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with scrape type 2
2025-11-27 19:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1290c6d4-7c99-57b8-b9f0-0c430eca5074, identifier: 116699888
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117491214
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491214%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117491214: 1
2025-11-27 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888
2025-11-27 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888
2025-11-27 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1290c6d4-7c99-57b8-b9f0-0c430eca5074 with identifier: 116699888 to the API
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116699888?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '1290c6d4-7c99-57b8-b9f0-0c430eca5074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22WNP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699888',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 32940,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699888%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Saving data for 116699888: {'auction_closing_time': 1764323100.0, 'created_time': 1762283561.389731, 'last_price_update_time': 1764270030.685675}
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116699888') HTTP/1.1" 204 0
2025-11-27 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117099044?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116339169?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117220810?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117025680?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116695109?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117490150
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117490150%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117490150: 1
2025-11-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117366081
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366081%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117366081: 1
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 108902135
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27108902135%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 108902135: 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116808330
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116808330%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116808330: 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117458919
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458919%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117458919: 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117288452
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288452%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117288452: 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117500005
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500005%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117500005: 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117101159
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101159%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117101159: 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117508940
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508940%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117508940: 0
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117411712
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411712%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117411712: 1
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 116763299
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116763299%27 HTTP/1.1" 200 None
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Scrape type for 116763299: 1
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117099044, 'registration': 'FL72YHK', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.6 Hybrid Elite 5dr Auto', 'mileage': 10240, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 40, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-17', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL72YHK/2025-11-11/image/31313d3d-b1bc-4b1a-a57c-beba7b9c2103_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/65ef0363-a685-4359-8805-23c29a31536a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/1bd98405-6301-485a-91d4-7c3ab2a659dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/ae5b301c-6e8c-4074-a103-e44ae6715f41_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/6b34feb2-81e9-4eda-a7ea-510f35aaf2d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/0d5bd799-d64c-4758-ac18-5a30507c1193_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/e12538b5-8de6-4bbe-83cc-7585f59dc52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/d7834cd5-9f56-49f8-9827-38a61ae1e290_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/b4de7535-509e-47e3-a6de-187670ac4bd2_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23- 3K, 02/25- 7K,', 'remarks': '**251**VOSA STATES 9K  SPARE KEY  CHARGING CABLE - / Cosmo 1 Harlekin curitiba - Jetblack / PP / Hard Wired Thinkware F100 16GB Dash Camera', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 30, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53d0e047-cfd3-4cd5-b933-36f109d23750.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117099044, 'registration': 'FL72YHK', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.6 Hybrid Elite 5dr Auto', 'mileage': 10240, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 40, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-17', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL72YHK/2025-11-11/image/31313d3d-b1bc-4b1a-a57c-beba7b9c2103_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/65ef0363-a685-4359-8805-23c29a31536a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/1bd98405-6301-485a-91d4-7c3ab2a659dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/ae5b301c-6e8c-4074-a103-e44ae6715f41_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/6b34feb2-81e9-4eda-a7ea-510f35aaf2d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/0d5bd799-d64c-4758-ac18-5a30507c1193_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/e12538b5-8de6-4bbe-83cc-7585f59dc52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/d7834cd5-9f56-49f8-9827-38a61ae1e290_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72YHK/2025-11-11/image/b4de7535-509e-47e3-a6de-187670ac4bd2_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23- 3K, 02/25- 7K,', 'remarks': '**251**VOSA STATES 9K  SPARE KEY  CHARGING CABLE - / Cosmo 1 Harlekin curitiba - Jetblack / PP / Hard Wired Thinkware F100 16GB Dash Camera', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 30, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53d0e047-cfd3-4cd5-b933-36f109d23750.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1865f4d-72cd-5d85-8760-e2a2237850e9 with identifier: 117099044
2025-11-27 19:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1865f4d-72cd-5d85-8760-e2a2237850e9 with scrape type 2
2025-11-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1865f4d-72cd-5d85-8760-e2a2237850e9 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e1865f4d-72cd-5d85-8760-e2a2237850e9, identifier: 117099044
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116339169, 'registration': 'SL72KND', 'account': 'ZEN002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 18725, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 57, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SL72KND/2025-11-27/image/18853ed8-1ebe-4f7b-ad0a-f123c6f96c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/0e083a1d-1bbf-4d0f-a059-61491a76a2d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/90a06186-cded-47db-bb5a-c680df834f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/7f36f323-00e3-4656-96ee-e82515551354_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/20180e92-51a9-4412-bc58-4c8c1307e2bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/8c8e93d0-5f2f-4532-a03d-46ac717d5be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/c81b2da5-e880-4fbf-a599-70b3f7abb5f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/4f7328eb-3003-439d-b651-2a7026e0ca45_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/33a47b4f-f80c-4307-b747-082fe63c6ad7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/25- 14K,', 'remarks': '**775**VOSA STATES 18K Two Coat Metallic Paint SPARE KEY  Two Coat Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8ec97f9-269c-48bb-954c-5ee132afeeab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116339169, 'registration': 'SL72KND', 'account': 'ZEN002', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 18725, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 57, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SL72KND/2025-11-27/image/18853ed8-1ebe-4f7b-ad0a-f123c6f96c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/0e083a1d-1bbf-4d0f-a059-61491a76a2d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/90a06186-cded-47db-bb5a-c680df834f39_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/7f36f323-00e3-4656-96ee-e82515551354_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/20180e92-51a9-4412-bc58-4c8c1307e2bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/8c8e93d0-5f2f-4532-a03d-46ac717d5be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/c81b2da5-e880-4fbf-a599-70b3f7abb5f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/4f7328eb-3003-439d-b651-2a7026e0ca45_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL72KND/2025-11-27/image/33a47b4f-f80c-4307-b747-082fe63c6ad7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/25- 14K,', 'remarks': '**775**VOSA STATES 18K Two Coat Metallic Paint SPARE KEY  Two Coat Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8ec97f9-269c-48bb-954c-5ee132afeeab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169
2025-11-27 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0, identifier: 116339169
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117220810, 'registration': 'KS22VKV', 'account': 'ZEN009', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '220i M Sport 4dr Step Auto', 'mileage': 29750, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 59, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-07-25', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KS22VKV/2025-11-14/image/78b3fd2b-e6fa-4ceb-bddd-2c527d773ca2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/4328613a-3f1c-4e9f-ad9c-ebb99c73d925_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/01e214d8-b372-4819-8d13-9c9f6f729ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/cd964ec1-8588-4634-82d8-253c279b3cf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/9008f9cb-2a72-4717-a2ae-93d4e1888205_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/cf6e594e-84e7-4df5-a0e7-b9dbcf1ac3ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/bc58da48-e964-402b-90ee-96f76e0d7d19_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/85282010-dbb5-493e-a2d7-2e3290af154c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/e9ea7209-acb8-4268-94dc-d061554dc5a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/2eb3f7a8-4f7b-40d1-bf5a-f56fc2a94832_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**964**VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8924f4d4-ece2-4cea-9cfe-d02e66a9a313.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117220810, 'registration': 'KS22VKV', 'account': 'ZEN009', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '220i M Sport 4dr Step Auto', 'mileage': 29750, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 59, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-07-25', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KS22VKV/2025-11-14/image/78b3fd2b-e6fa-4ceb-bddd-2c527d773ca2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/4328613a-3f1c-4e9f-ad9c-ebb99c73d925_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/01e214d8-b372-4819-8d13-9c9f6f729ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/cd964ec1-8588-4634-82d8-253c279b3cf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/9008f9cb-2a72-4717-a2ae-93d4e1888205_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/cf6e594e-84e7-4df5-a0e7-b9dbcf1ac3ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/bc58da48-e964-402b-90ee-96f76e0d7d19_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/85282010-dbb5-493e-a2d7-2e3290af154c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/e9ea7209-acb8-4268-94dc-d061554dc5a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KS22VKV/2025-11-14/image/2eb3f7a8-4f7b-40d1-bf5a-f56fc2a94832_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**964**VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8924f4d4-ece2-4cea-9cfe-d02e66a9a313.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8724409-a0f5-5d67-9e65-4e78918f3941 with identifier: 117220810
2025-11-27 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8724409-a0f5-5d67-9e65-4e78918f3941 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8724409-a0f5-5d67-9e65-4e78918f3941 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a8724409-a0f5-5d67-9e65-4e78918f3941, identifier: 117220810
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117025680, 'registration': 'KM71ORT', 'account': 'ZEN009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto', 'mileage': 34057, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 50, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-05', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM71ORT/2025-11-12/image/c62bb686-4e74-46fb-b0fa-1441a09f03d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/1bdd9563-7fb5-48b8-ab4b-7e5167cc5aaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/d1356123-1e98-4cde-9a13-9e44ce439f2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/57cd36a1-d462-4ecb-b4a3-f8dcc6188354_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/4ead4f7c-e095-4aa6-8d83-365017528a53_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/c919a188-d7b5-4bb0-a84a-4459d2e70bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/60f82eca-aeb3-4e0e-9bff-38da4240b658_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/6eb7e899-1746-4113-86ef-d22069e910da_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/44bf098a-4422-48a7-94c1-6acd17e22570_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/6ac3dd7c-8942-4ac7-8f8b-dc25388415a0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 07/24-20K,', 'remarks': '**899**VOSA STATES 25K, 34K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 167, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9ebe8ac3-c698-4b9c-b2b2-bbf4e4156028.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117025680, 'registration': 'KM71ORT', 'account': 'ZEN009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto', 'mileage': 34057, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 50, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-05', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM71ORT/2025-11-12/image/c62bb686-4e74-46fb-b0fa-1441a09f03d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/1bdd9563-7fb5-48b8-ab4b-7e5167cc5aaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/d1356123-1e98-4cde-9a13-9e44ce439f2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/57cd36a1-d462-4ecb-b4a3-f8dcc6188354_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/4ead4f7c-e095-4aa6-8d83-365017528a53_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/c919a188-d7b5-4bb0-a84a-4459d2e70bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/60f82eca-aeb3-4e0e-9bff-38da4240b658_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/6eb7e899-1746-4113-86ef-d22069e910da_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/44bf098a-4422-48a7-94c1-6acd17e22570_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71ORT/2025-11-12/image/6ac3dd7c-8942-4ac7-8f8b-dc25388415a0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 07/24-20K,', 'remarks': '**899**VOSA STATES 25K, 34K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 167, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9ebe8ac3-c698-4b9c-b2b2-bbf4e4156028.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57515ac7-d010-5ec5-acf9-283ed5616e09 with identifier: 117025680
2025-11-27 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57515ac7-d010-5ec5-acf9-283ed5616e09 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57515ac7-d010-5ec5-acf9-283ed5616e09 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 57515ac7-d010-5ec5-acf9-283ed5616e09, identifier: 117025680
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116695109, 'registration': 'KM23SVK', 'account': 'ZEN009', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d M Sport 5dr Step Auto [Live Cockpit Pro]', 'mileage': 51334, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 47, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-03-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM23SVK/2025-11-17/image/b9447ad0-0c34-472c-95a5-48a9037261d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/cdcb6796-daf8-4491-b553-e8f33c8abdab_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/fcf795e4-862c-4e6d-be10-f902ef44acf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/d19abe77-5632-4181-aa8c-2b5b040418db_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/ce4dc3fd-0ffc-478e-878a-d4d30e630f99_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/4e18aeca-5e44-4ce5-8b74-ed7bedac5bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/27a20b41-5fc1-40b8-9b93-9c988fe2260c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/39d9b04b-d79c-4806-87b7-a6797aac9e4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/67bb3647-906d-4c94-ae50-c7c2960d6d0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/4b8aaa06-3db0-4bb9-a5cf-3c87a47373a3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**885**  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f888a97-ef7c-42ca-8551-a207b7f2c0b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116695109, 'registration': 'KM23SVK', 'account': 'ZEN009', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d M Sport 5dr Step Auto [Live Cockpit Pro]', 'mileage': 51334, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 47, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-03-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM23SVK/2025-11-17/image/b9447ad0-0c34-472c-95a5-48a9037261d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/cdcb6796-daf8-4491-b553-e8f33c8abdab_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/fcf795e4-862c-4e6d-be10-f902ef44acf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/d19abe77-5632-4181-aa8c-2b5b040418db_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/ce4dc3fd-0ffc-478e-878a-d4d30e630f99_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/4e18aeca-5e44-4ce5-8b74-ed7bedac5bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/27a20b41-5fc1-40b8-9b93-9c988fe2260c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/39d9b04b-d79c-4806-87b7-a6797aac9e4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/67bb3647-906d-4c94-ae50-c7c2960d6d0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM23SVK/2025-11-17/image/4b8aaa06-3db0-4bb9-a5cf-3c87a47373a3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**885**  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f888a97-ef7c-42ca-8551-a207b7f2c0b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a48595b9-f493-531a-953b-cfb1834ae837 with identifier: 116695109
2025-11-27 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a48595b9-f493-531a-953b-cfb1834ae837 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a48595b9-f493-531a-953b-cfb1834ae837 with scrape type 2
2025-11-27 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a48595b9-f493-531a-953b-cfb1834ae837, identifier: 116695109
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 116855883
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116855883%27 HTTP/1.1" 200 None
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Scrape type for 116855883: 0
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117339782
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339782%27 HTTP/1.1" 200 None
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117339782: 0
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117169329
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117169329%27 HTTP/1.1" 200 None
2025-11-27 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117169329: 2
2025-11-27 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e1865f4d-72cd-5d85-8760-e2a2237850e9 with identifier: 117099044
2025-11-27 19:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e1865f4d-72cd-5d85-8760-e2a2237850e9 with identifier: 117099044
2025-11-27 19:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e1865f4d-72cd-5d85-8760-e2a2237850e9 with identifier: 117099044 to the API
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117099044?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'e1865f4d-72cd-5d85-8760-e2a2237850e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FL72YHK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099044',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND HATCHBACK',
 'odometer': 10240,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seller_name': 'Kinto',
 'title': 'VAUXHALL GRANDLAND HATCHBACK 1.6 Hybrid Elite 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Hybrid Elite 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099044%27 HTTP/1.1" 200 None
2025-11-27 19:00:32 [astonbarclay.gb] INFO: Saving data for 117099044: {'auction_closing_time': 1764323100.0, 'created_time': 1763406211.443135, 'last_price_update_time': 1764270032.105715}
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099044') HTTP/1.1" 204 0
2025-11-27 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169
2025-11-27 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169
2025-11-27 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0 with identifier: 116339169 to the API
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116339169?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'f8f0dc3e-a984-5a1c-8e5e-19ee974cc2f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SL72KND',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116339169',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 18725,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Zenith',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 Elite Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 Elite Edition 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116339169%27 HTTP/1.1" 200 None
2025-11-27 19:00:32 [astonbarclay.gb] INFO: Saving data for 116339169: {'auction_closing_time': 1764323100.0, 'created_time': 1762284113.69363, 'last_price_update_time': 1764270032.493859}
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116339169') HTTP/1.1" 204 0
2025-11-27 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a8724409-a0f5-5d67-9e65-4e78918f3941 with identifier: 117220810
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-11-27 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a8724409-a0f5-5d67-9e65-4e78918f3941 with identifier: 117220810
2025-11-27 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a8724409-a0f5-5d67-9e65-4e78918f3941 with identifier: 117220810 to the API
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117220810?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a8724409-a0f5-5d67-9e65-4e78918f3941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KS22VKV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117220810',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 29750,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seller_name': 'Zenith',
 'title': 'BMW 2 SERIES GRAN COUPE 220i M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '220i M Sport 4dr Step Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117220810%27 HTTP/1.1" 200 None
2025-11-27 19:00:32 [astonbarclay.gb] INFO: Saving data for 117220810: {'auction_closing_time': 1764323100.0, 'created_time': 1763492893.174632, 'last_price_update_time': 1764270032.942621}
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117220810') HTTP/1.1" 204 0
2025-11-27 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 57515ac7-d010-5ec5-acf9-283ed5616e09 with identifier: 117025680
2025-11-27 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 57515ac7-d010-5ec5-acf9-283ed5616e09 with identifier: 117025680
2025-11-27 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 57515ac7-d010-5ec5-acf9-283ed5616e09 with identifier: 117025680 to the API
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117025680?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '57515ac7-d010-5ec5-acf9-283ed5616e09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KM71ORT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117025680',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 34057,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-31',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES HATCHBACK M135i xDrive 5dr Step Auto',
 'transmission': 'automatic',
 'trim': 'M135i xDrive 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117025680%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Saving data for 117025680: {'auction_closing_time': 1764323100.0, 'created_time': 1763492888.299214, 'last_price_update_time': 1764270033.222561}
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117025680') HTTP/1.1" 204 0
2025-11-27 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a48595b9-f493-531a-953b-cfb1834ae837 with identifier: 116695109
2025-11-27 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a48595b9-f493-531a-953b-cfb1834ae837 with identifier: 116695109
2025-11-27 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a48595b9-f493-531a-953b-cfb1834ae837 with identifier: 116695109 to the API
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116695109?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'a48595b9-f493-531a-953b-cfb1834ae837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KM23SVK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116695109',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 51334,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-31',
 'seller_name': 'Zenith',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d M Sport 5dr Step Auto [Live '
          'Cockpit Pro]',
 'transmission': 'automatic',
 'trim': '116d M Sport 5dr Step Auto [Live Cockpit Pro]',
 'vin': None,
 'year': 2023}
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116695109%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Saving data for 116695109: {'auction_closing_time': 1764323100.0, 'created_time': 1763492925.618601, 'last_price_update_time': 1764270033.498675}
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116695109') HTTP/1.1" 204 0
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 115680805
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115680805%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 115680805: 0
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117052977
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117052977%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117052977: 0
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117024058
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117024058: 2
2025-11-27 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117215446?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117270782?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116884737?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117024353
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117024353: 2
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117024415
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024415%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117024415: 2
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117031158
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117031158%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117031158: 2
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117288542
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117288542: 2
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117289360
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117289360: 2
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117440649
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440649%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117440649: 2
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117440690
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117440690: 2
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117215446, 'registration': 'MH21EZN', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]', 'mileage': 106164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 70, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-26', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MH21EZN/2025-11-14/image/dd883ec9-84dc-4a9c-8cd3-c6a3d1d4fb78_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/38f1da40-2f74-4769-952d-fb783000178c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/434da3f3-0ce0-431c-9396-ecd10665b22e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/91ca64f6-d5ac-4fbe-8af7-1cae457910a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cd606bf5-0821-42ab-b977-b06bfc31cb5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/aaa385ee-0d24-479d-9733-9a6717990bcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/49974193-12b4-401e-b22a-b75dcdb6f573_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cc4a1912-c821-4f1d-8e4d-6932cee50953_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/e2ba51c6-d864-43a2-bbe4-beee3ed538d2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22-28K, 08/23-57K, 11/23-66K, 07/24-80K, 07/25-99K,', 'remarks': '**936**VOSA STATES 80K, 99K  SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b7780122-0aea-4155-b3af-0da18ebc4617.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117215446, 'registration': 'MH21EZN', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]', 'mileage': 106164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 70, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-26', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MH21EZN/2025-11-14/image/dd883ec9-84dc-4a9c-8cd3-c6a3d1d4fb78_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/38f1da40-2f74-4769-952d-fb783000178c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/434da3f3-0ce0-431c-9396-ecd10665b22e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/91ca64f6-d5ac-4fbe-8af7-1cae457910a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cd606bf5-0821-42ab-b977-b06bfc31cb5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/aaa385ee-0d24-479d-9733-9a6717990bcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/49974193-12b4-401e-b22a-b75dcdb6f573_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/cc4a1912-c821-4f1d-8e4d-6932cee50953_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH21EZN/2025-11-14/image/e2ba51c6-d864-43a2-bbe4-beee3ed538d2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22-28K, 08/23-57K, 11/23-66K, 07/24-80K, 07/25-99K,', 'remarks': '**936**VOSA STATES 80K, 99K  SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b7780122-0aea-4155-b3af-0da18ebc4617.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51f7406-c301-5167-b4b1-48b5bfb87038 with identifier: 117215446
2025-11-27 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51f7406-c301-5167-b4b1-48b5bfb87038 with scrape type 2
2025-11-27 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51f7406-c301-5167-b4b1-48b5bfb87038 with scrape type 2
2025-11-27 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b51f7406-c301-5167-b4b1-48b5bfb87038, identifier: 117215446
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117270782, 'registration': 'EX71HSG', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL ESTATE', 'derivative': '2.0 TDI Style 5dr DSG', 'mileage': 70837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 74, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-16', 'fuel': 'Diesel', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EX71HSG/2025-11-27/image/27d16897-81ba-461c-a08e-81a44960f3d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/3a080711-c063-4463-a4b8-983eb18b8111_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/cd730067-3b4c-4078-bf25-9df5f9dba3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/314b51c3-0be0-44d3-b9f2-785425b2b9f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/fd4dc197-5af0-4aa1-95a6-cd1401412aec_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/22e3ac9f-c048-4ab7-abf0-95ccc5c57a1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/6ccd9ad5-cb61-410f-a989-b0764b6a238d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/a52f385b-abab-4475-829a-6a465842ae3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/c217878d-914a-44b9-9722-f6578a9a5b97_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22- 6K, 06/23- 18K, 02/24- 44K, 01/25- 49K, 06/25- 60K, 10/25- 68K', 'remarks': '**753**VOSA STATES 47K, 68K  \t Pure White Paint  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f5063f04-d2b5-4415-b6c9-3329575e0613.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117270782, 'registration': 'EX71HSG', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL ESTATE', 'derivative': '2.0 TDI Style 5dr DSG', 'mileage': 70837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 74, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-16', 'fuel': 'Diesel', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EX71HSG/2025-11-27/image/27d16897-81ba-461c-a08e-81a44960f3d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/3a080711-c063-4463-a4b8-983eb18b8111_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/cd730067-3b4c-4078-bf25-9df5f9dba3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/314b51c3-0be0-44d3-b9f2-785425b2b9f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/fd4dc197-5af0-4aa1-95a6-cd1401412aec_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/22e3ac9f-c048-4ab7-abf0-95ccc5c57a1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/6ccd9ad5-cb61-410f-a989-b0764b6a238d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/a52f385b-abab-4475-829a-6a465842ae3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71HSG/2025-11-27/image/c217878d-914a-44b9-9722-f6578a9a5b97_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22- 6K, 06/23- 18K, 02/24- 44K, 01/25- 49K, 06/25- 60K, 10/25- 68K', 'remarks': '**753**VOSA STATES 47K, 68K  \t Pure White Paint  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f5063f04-d2b5-4415-b6c9-3329575e0613.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a9fcfc-738d-5de1-aaef-b1c2c5a63103 with identifier: 117270782
2025-11-27 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a9fcfc-738d-5de1-aaef-b1c2c5a63103 with scrape type 2
2025-11-27 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83a9fcfc-738d-5de1-aaef-b1c2c5a63103 with scrape type 2
2025-11-27 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 83a9fcfc-738d-5de1-aaef-b1c2c5a63103, identifier: 117270782
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116884737, 'registration': 'DV73WYG', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC60 ESTATE', 'derivative': '2.0 B5P Ultimate Dark 5dr AWD Geartronic', 'mileage': 7646, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 82, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV73WYG/2025-11-27/image/bfb88551-7ac3-4866-bfda-76f192bb307e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/5317c5f0-0b53-413e-8a6c-4e9ec7424372_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9b6de8b4-66c1-437d-abd6-4148baed33c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/c144689d-f68d-4c0a-b6ee-11bf8e104589_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/975e5c8e-c703-4834-9b5f-8d8ab6c89387_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/a3b66de3-f05e-47dd-9b8b-53368d26e06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/db4ce05a-f8ce-40e0-9bad-f7db335a0075_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/ac274279-59e2-442d-a5db-af92aa26190b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/826624f3-c397-4ddd-a2d2-3d4856f7b861_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9246bbd9-4c01-437f-ab1d-56d4b2fcabad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25-6K', 'remarks': '**731** SPARE KEY Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 185, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8de65194-7672-424d-b270-7b104a15ac87.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116884737, 'registration': 'DV73WYG', 'account': 'ZEN002', 'make': 'VOLVO', 'model': 'XC60 ESTATE', 'derivative': '2.0 B5P Ultimate Dark 5dr AWD Geartronic', 'mileage': 7646, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 82, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-02-13', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV73WYG/2025-11-27/image/bfb88551-7ac3-4866-bfda-76f192bb307e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/5317c5f0-0b53-413e-8a6c-4e9ec7424372_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9b6de8b4-66c1-437d-abd6-4148baed33c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/c144689d-f68d-4c0a-b6ee-11bf8e104589_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/975e5c8e-c703-4834-9b5f-8d8ab6c89387_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/a3b66de3-f05e-47dd-9b8b-53368d26e06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/db4ce05a-f8ce-40e0-9bad-f7db335a0075_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/ac274279-59e2-442d-a5db-af92aa26190b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/826624f3-c397-4ddd-a2d2-3d4856f7b861_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV73WYG/2025-11-27/image/9246bbd9-4c01-437f-ab1d-56d4b2fcabad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25-6K', 'remarks': '**731** SPARE KEY Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 185, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8de65194-7672-424d-b270-7b104a15ac87.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737
2025-11-27 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d63a91-5eb6-56e4-a233-b410c801bc54 with scrape type 2
2025-11-27 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39d63a91-5eb6-56e4-a233-b410c801bc54 with scrape type 2
2025-11-27 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 39d63a91-5eb6-56e4-a233-b410c801bc54, identifier: 116884737
2025-11-27 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117123611
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123611%27 HTTP/1.1" 200 None
2025-11-27 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117123611: 2
2025-11-27 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b51f7406-c301-5167-b4b1-48b5bfb87038 with identifier: 117215446
2025-11-27 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b51f7406-c301-5167-b4b1-48b5bfb87038 with identifier: 117215446
2025-11-27 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170853
2025-11-27 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b51f7406-c301-5167-b4b1-48b5bfb87038 spider: astonbarclay.gb
2025-11-27 19:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b51f7406-c301-5167-b4b1-48b5bfb87038 due to rule: high_mileage_for_country.json, error: 170853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170853
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'b51f7406-c301-5167-b4b1-48b5bfb87038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MH21EZN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117215446',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 106164,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seller_name': 'Zenith',
 'title': 'AUDI A3 SPORTBACK 40 TFSI e Sport 5dr S Tronic [Comfort+Sound]',
 'transmission': 'automatic',
 'trim': '40 TFSI e Sport 5dr S Tronic [Comfort+Sound]',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215446%27 HTTP/1.1" 200 None
2025-11-27 19:00:34 [astonbarclay.gb] INFO: Saving data for 117215446: {'auction_closing_time': 1764323100.0, 'created_time': 1763492885.062671, 'last_price_update_time': 1764270034.275201}
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117215446') HTTP/1.1" 204 0
2025-11-27 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 83a9fcfc-738d-5de1-aaef-b1c2c5a63103 with identifier: 117270782
2025-11-27 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 83a9fcfc-738d-5de1-aaef-b1c2c5a63103 with identifier: 117270782
2025-11-27 19:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 83a9fcfc-738d-5de1-aaef-b1c2c5a63103 with identifier: 117270782 to the API
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117270782?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '83a9fcfc-738d-5de1-aaef-b1c2c5a63103',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'EX71HSG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117270782',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL ESTATE',
 'odometer': 70837,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN GOLF DIESEL ESTATE 2.0 TDI Style 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI Style 5dr DSG',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270782%27 HTTP/1.1" 200 None
2025-11-27 19:00:34 [astonbarclay.gb] INFO: Saving data for 117270782: {'auction_closing_time': 1764323100.0, 'created_time': 1763492926.005154, 'last_price_update_time': 1764270034.676323}
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117270782') HTTP/1.1" 204 0
2025-11-27 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737
2025-11-27 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737
2025-11-27 19:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 39d63a91-5eb6-56e4-a233-b410c801bc54 with identifier: 116884737 to the API
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2739d63a91-5eb6-56e4-a233-b410c801bc54%27 HTTP/1.1" 200 None
2025-11-27 19:00:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 39d63a91-5eb6-56e4-a233-b410c801bc54: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116884737?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '39d63a91-5eb6-56e4-a233-b410c801bc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV73WYG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116884737',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'XC60 ESTATE',
 'odometer': 7646,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-13',
 'seller_name': 'Zenith',
 'title': 'VOLVO XC60 ESTATE 2.0 B5P Ultimate Dark 5dr AWD Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 B5P Ultimate Dark 5dr AWD Geartronic',
 'vin': None,
 'year': 2024}
2025-11-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884737%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Saving data for 116884737: {'auction_closing_time': 1764323100.0, 'created_time': 1763492829.457915, 'last_price_update_time': 1764270035.007356}
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116884737') HTTP/1.1" 204 0
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117175584
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117175584: 2
2025-11-27 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116832725?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117311401?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116383281?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116809736?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117019889?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117243027
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243027%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117243027: 2
2025-11-27 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117243071
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117243071: 2
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117051310
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117051310%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117051310: 2
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117131404
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117131404: 2
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117131550
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117131550: 2
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117131446
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117131446: 2
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117341295
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117341295%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117341295: 2
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116832725, 'registration': 'MJ71YYH', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 51929, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 108, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-20', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e1f2a5b1-25cc-4b26-90ae-927c23ce24a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5bcfce37-adbd-4904-b8ed-42444e4d3ec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5b3f9e01-4611-4e6f-a892-a72fb8e437c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/77275e62-673a-47e6-a2eb-37c616b41eab_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/96442a70-7a84-49b2-b090-ebd9065cbded_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/ada7f348-62c3-4a8d-8fac-8cc7c0f435c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/3fc3f528-d4e5-4b92-a3f5-a54ee6c7a716_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/f25b9ec2-3920-4a88-8249-dd66a5f5ce4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e3fd389f-6dcc-4f55-989d-914dcb6d8ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/d53b4f27-5049-4168-b046-3111f523b43d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24- 35K, 10/25- 49K', 'remarks': '**770**VOSA STATES 35K, 49K SPARE KEY   \t Solid Paint, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07e758a2-7d13-457c-9983-1857b087d111.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116832725, 'registration': 'MJ71YYH', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 51929, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 108, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-20', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e1f2a5b1-25cc-4b26-90ae-927c23ce24a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5bcfce37-adbd-4904-b8ed-42444e4d3ec9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/5b3f9e01-4611-4e6f-a892-a72fb8e437c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/77275e62-673a-47e6-a2eb-37c616b41eab_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/96442a70-7a84-49b2-b090-ebd9065cbded_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/ada7f348-62c3-4a8d-8fac-8cc7c0f435c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/3fc3f528-d4e5-4b92-a3f5-a54ee6c7a716_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/f25b9ec2-3920-4a88-8249-dd66a5f5ce4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/e3fd389f-6dcc-4f55-989d-914dcb6d8ff3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YYH/2025-11-27/image/d53b4f27-5049-4168-b046-3111f523b43d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24- 35K, 10/25- 49K', 'remarks': '**770**VOSA STATES 35K, 49K SPARE KEY   \t Solid Paint, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07e758a2-7d13-457c-9983-1857b087d111.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725
2025-11-27 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc5d71c-e761-56cc-ba45-efddbe7eb208 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbc5d71c-e761-56cc-ba45-efddbe7eb208 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dbc5d71c-e761-56cc-ba45-efddbe7eb208, identifier: 116832725
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117311401, 'registration': 'YK21FPW', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF ESTATE', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 66322, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 84, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-07-05', 'fuel': 'Petrol', 'motExpiry': '2026-07-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK21FPW/2025-11-18/image/a605f0fb-f602-4827-b2af-53720f81389b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/0d5ed8f7-57af-4493-ae64-47768aa521a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/38a91f87-60a6-4774-96aa-5475192d4e7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/9439a47a-18c4-4f38-b73c-5414e1f273a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/c9f39247-088a-4ee6-966f-f1ad9fed4cdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/d003b278-c72a-4c90-848f-c8bb574f1723_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/b4634c59-a0fd-43b3-8f71-3f29cc874ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/464fa3cc-c503-4f6d-8cf3-affe3e4b507d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/e72f89b5-4121-4559-804d-04e25e1eb68a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22- 18K, 04/24- 42K', 'remarks': '**982** VOSA STATES 45K, 58K SPARE KEY  17in Ventura Alloys+anti Theft Whl Bolts\tRear Tinted Glass\tSpace+weight Saving Spare Wheel', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62757095-8d57-4cea-8a17-6a00edd85259.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117311401, 'registration': 'YK21FPW', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'GOLF ESTATE', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 66322, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 84, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-07-05', 'fuel': 'Petrol', 'motExpiry': '2026-07-04', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK21FPW/2025-11-18/image/a605f0fb-f602-4827-b2af-53720f81389b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/0d5ed8f7-57af-4493-ae64-47768aa521a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/38a91f87-60a6-4774-96aa-5475192d4e7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/9439a47a-18c4-4f38-b73c-5414e1f273a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/c9f39247-088a-4ee6-966f-f1ad9fed4cdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/d003b278-c72a-4c90-848f-c8bb574f1723_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/b4634c59-a0fd-43b3-8f71-3f29cc874ba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/464fa3cc-c503-4f6d-8cf3-affe3e4b507d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK21FPW/2025-11-18/image/e72f89b5-4121-4559-804d-04e25e1eb68a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/22- 18K, 04/24- 42K', 'remarks': '**982** VOSA STATES 45K, 58K SPARE KEY  17in Ventura Alloys+anti Theft Whl Bolts\tRear Tinted Glass\tSpace+weight Saving Spare Wheel', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62757095-8d57-4cea-8a17-6a00edd85259.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401
2025-11-27 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cb433c-dc51-57a1-baa8-eb359e0ec833 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1cb433c-dc51-57a1-baa8-eb359e0ec833 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1cb433c-dc51-57a1-baa8-eb359e0ec833, identifier: 117311401
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116383281, 'registration': 'LV73MGY', 'account': 'ZEN002', 'make': 'PORSCHE', 'model': 'TAYCAN SALOON', 'derivative': '420kW 4S 93kWh 4dr Auto [5 Seat]', 'mileage': 11833, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 86, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-01', 'fuel': 'Electric', 'motExpiry': None, 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LV73MGY/2025-11-27/image/ba84884e-a9df-4e31-83b4-d22c2585fa8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/5c16c234-26fd-4258-9df1-1d22551f3543_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/56ae1f1a-ea67-48b6-989b-fe52e97f07ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/5e42100d-9f42-42ca-9ff0-339045ad912d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/a517a795-751e-4073-a6de-d83be9071fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/84ffea45-4ecd-436c-9969-ac0879a0b00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/fd76b34b-90ea-4cf8-85a9-5575bcf8fcf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/4ca65d50-32f0-456c-8e0d-a7b571643dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/6c1cca68-b744-4709-8951-a7e2df984dd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/232fdf81-a421-4733-bb54-f015f3ef1441_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1953**  SPARE KEY Metallic Paint\tTwo Tone Partial Leather Interior  CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/18394009-c982-4a65-8e58-784bec48515a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116383281, 'registration': 'LV73MGY', 'account': 'ZEN002', 'make': 'PORSCHE', 'model': 'TAYCAN SALOON', 'derivative': '420kW 4S 93kWh 4dr Auto [5 Seat]', 'mileage': 11833, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 86, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-01', 'fuel': 'Electric', 'motExpiry': None, 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LV73MGY/2025-11-27/image/ba84884e-a9df-4e31-83b4-d22c2585fa8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/5c16c234-26fd-4258-9df1-1d22551f3543_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/56ae1f1a-ea67-48b6-989b-fe52e97f07ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/5e42100d-9f42-42ca-9ff0-339045ad912d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/a517a795-751e-4073-a6de-d83be9071fae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/84ffea45-4ecd-436c-9969-ac0879a0b00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/fd76b34b-90ea-4cf8-85a9-5575bcf8fcf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/4ca65d50-32f0-456c-8e0d-a7b571643dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/6c1cca68-b744-4709-8951-a7e2df984dd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV73MGY/2025-11-27/image/232fdf81-a421-4733-bb54-f015f3ef1441_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1953**  SPARE KEY Metallic Paint\tTwo Tone Partial Leather Interior  CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/18394009-c982-4a65-8e58-784bec48515a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c428a25-5baa-5e42-8e6d-7c725817374e with identifier: 116383281
2025-11-27 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c428a25-5baa-5e42-8e6d-7c725817374e with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c428a25-5baa-5e42-8e6d-7c725817374e with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3c428a25-5baa-5e42-8e6d-7c725817374e, identifier: 116383281
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116809736, 'registration': 'OE72MTJ', 'account': 'ZEN009', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '170kW 69kWh Standard Range SM [Plus] 5dr Auto', 'mileage': 24573, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 66, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-15', 'fuel': 'Electric', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/bae23ae9-a74e-4712-bbbf-2e4bceea0782_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/5aedf3b3-2ee4-4cb9-9ab2-5925eebf90a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/e8a376d7-2780-4de4-be41-4f7a4ddf176a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/86fc6d9d-f0a9-4d98-8c8d-ae55f234d355_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/b1a20ecf-de29-4d7b-86ec-368aaf06b820_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/3d238f39-21a2-4f10-9695-69bc4525ca74_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/3edfba52-9183-46e9-8af8-7c4577c9c535_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/cd7c5936-3675-4995-bfb9-a1b29ba6753c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/7e343492-dccc-48e3-99b1-822a0320c3d9_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**847**VOSA STATES 23K  CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7288cdc6-e0b5-42ba-9386-f92b1575c986.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116809736, 'registration': 'OE72MTJ', 'account': 'ZEN009', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '170kW 69kWh Standard Range SM [Plus] 5dr Auto', 'mileage': 24573, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 66, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-15', 'fuel': 'Electric', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/bae23ae9-a74e-4712-bbbf-2e4bceea0782_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/5aedf3b3-2ee4-4cb9-9ab2-5925eebf90a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/e8a376d7-2780-4de4-be41-4f7a4ddf176a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/86fc6d9d-f0a9-4d98-8c8d-ae55f234d355_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/b1a20ecf-de29-4d7b-86ec-368aaf06b820_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/3d238f39-21a2-4f10-9695-69bc4525ca74_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/3edfba52-9183-46e9-8af8-7c4577c9c535_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/cd7c5936-3675-4995-bfb9-a1b29ba6753c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72MTJ/2025-11-17/image/7e343492-dccc-48e3-99b1-822a0320c3d9_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**847**VOSA STATES 23K  CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7288cdc6-e0b5-42ba-9386-f92b1575c986.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f0b638-ab26-53b3-b453-74de3f7e0051 with identifier: 116809736
2025-11-27 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f0b638-ab26-53b3-b453-74de3f7e0051 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f0b638-ab26-53b3-b453-74de3f7e0051 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 87f0b638-ab26-53b3-b453-74de3f7e0051, identifier: 116809736
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117019889, 'registration': 'DV71EDL', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'IONIQ HATCHBACK', 'derivative': '1.6 GDi Hybrid Premium 5dr DCT', 'mileage': 34422, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 100, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-13', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV71EDL/2025-11-19/image/e8d6f6a7-890c-428f-8131-2d992a4413e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/1483a129-ff10-4ef1-b55b-ddb9d94a387e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/242b0720-bbed-408a-b0f4-436d6720660f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/69dbf7bf-ec74-49f1-ba1a-1faa40b46ee3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/91a01fee-83ad-463a-9601-4a0a38d08990_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/edde63f8-9022-429e-a09a-959984e428ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/be21d4a9-327e-4d6e-8975-ca813f028644_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/43207eb6-f9dd-4bcf-a48e-d64e7f838cf5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/2dceb7c3-7575-4c03-9e36-0d6701120afc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/22 - 9K, 11/23 - 19K, 10/24 - 25K, 09/25 - 32K', 'remarks': '**776*VOSA STATES 25K, 32K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc18f5d5-2564-46e4-aa03-1d7058c33907.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117019889, 'registration': 'DV71EDL', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'IONIQ HATCHBACK', 'derivative': '1.6 GDi Hybrid Premium 5dr DCT', 'mileage': 34422, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 100, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-30', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-13', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV71EDL/2025-11-19/image/e8d6f6a7-890c-428f-8131-2d992a4413e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/1483a129-ff10-4ef1-b55b-ddb9d94a387e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/242b0720-bbed-408a-b0f4-436d6720660f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/69dbf7bf-ec74-49f1-ba1a-1faa40b46ee3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/91a01fee-83ad-463a-9601-4a0a38d08990_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/edde63f8-9022-429e-a09a-959984e428ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/be21d4a9-327e-4d6e-8975-ca813f028644_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/43207eb6-f9dd-4bcf-a48e-d64e7f838cf5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV71EDL/2025-11-19/image/2dceb7c3-7575-4c03-9e36-0d6701120afc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/22 - 9K, 11/23 - 19K, 10/24 - 25K, 09/25 - 32K', 'remarks': '**776*VOSA STATES 25K, 32K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 102, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc18f5d5-2564-46e4-aa03-1d7058c33907.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5f468f-b0e4-5de0-89ba-597f571e4a41 with identifier: 117019889
2025-11-27 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5f468f-b0e4-5de0-89ba-597f571e4a41 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de5f468f-b0e4-5de0-89ba-597f571e4a41 with scrape type 2
2025-11-27 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: de5f468f-b0e4-5de0-89ba-597f571e4a41, identifier: 117019889
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 116639589
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116639589%27 HTTP/1.1" 200 None
2025-11-27 19:00:35 [astonbarclay.gb] INFO: Scrape type for 116639589: 2
2025-11-27 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-11-27 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725
2025-11-27 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dbc5d71c-e761-56cc-ba45-efddbe7eb208 with identifier: 116832725 to the API
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116832725?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'dbc5d71c-e761-56cc-ba45-efddbe7eb208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ71YYH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116832725',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 51929,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-20',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832725%27 HTTP/1.1" 200 None
2025-11-27 19:00:36 [astonbarclay.gb] INFO: Saving data for 116832725: {'auction_closing_time': 1764323100.0, 'created_time': 1764147701.941899, 'last_price_update_time': 1764270036.209732}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116832725') HTTP/1.1" 204 0
2025-11-27 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401
2025-11-27 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1cb433c-dc51-57a1-baa8-eb359e0ec833 with identifier: 117311401 to the API
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117311401?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a1cb433c-dc51-57a1-baa8-eb359e0ec833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YK21FPW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117311401',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF ESTATE',
 'odometer': 66322,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN GOLF ESTATE 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311401%27 HTTP/1.1" 200 None
2025-11-27 19:00:36 [astonbarclay.gb] INFO: Saving data for 117311401: {'auction_closing_time': 1764323100.0, 'created_time': 1763492625.033973, 'last_price_update_time': 1764270036.482059}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117311401') HTTP/1.1" 204 0
2025-11-27 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3c428a25-5baa-5e42-8e6d-7c725817374e with identifier: 116383281
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3c428a25-5baa-5e42-8e6d-7c725817374e with identifier: 116383281
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'porsche taycan saloon 420kw 4s 93kwh 4dr auto [5 seat]', 'price': 0, 'currency': 'gbp', 'make': 'porsche', 'model': 'taycan saloon', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 11833, 'odometer_reading_unit': 'mi', 'registration_date': '2023-11-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116383281', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '420kw 4s 93kwh 4dr auto [5 seat]', 'license_plate': 'lv73mgy', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 4, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '3c428a25-5baa-5e42-8e6d-7c725817374e', 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'porsche taycan saloon', 'sanitized_make': 'porsche', 'odometer_in_km': 19043} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '3c428a25-5baa-5e42-8e6d-7c725817374e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'lv73mgy',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116383281',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'porsche',
     'make_model': 'porsche taycan saloon',
     'model': 'taycan saloon',
     'odometer': 11833,
     'odometer_in_km': 19043,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-11-01',
     'sanitized_make': 'porsche',
     'seller_name': 'zenith',
     'title': 'porsche taycan saloon 420kw 4s 93kwh 4dr auto [5 seat]',
     'transmission': 'automatic',
     'trim': '420kw 4s 93kwh 4dr auto [5 seat]',
     'vin': None,
     'year': 2023}
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 3c428a25-5baa-5e42-8e6d-7c725817374e spider: astonbarclay.gb
2025-11-27 19:00:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3c428a25-5baa-5e42-8e6d-7c725817374e due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'porsche taycan saloon 420kw 4s 93kwh 4dr auto [5 seat]', 'price': 0, 'currency': 'gbp', 'make': 'porsche', 'model': 'taycan saloon', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 11833, 'odometer_reading_unit': 'mi', 'registration_date': '2023-11-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116383281', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '420kw 4s 93kwh 4dr auto [5 seat]', 'license_plate': 'lv73mgy', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 4, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '3c428a25-5baa-5e42-8e6d-7c725817374e', 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'porsche taycan saloon', 'sanitized_make': 'porsche', 'odometer_in_km': 19043} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '3c428a25-5baa-5e42-8e6d-7c725817374e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'lv73mgy',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116383281',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'porsche',
     'make_model': 'porsche taycan saloon',
     'model': 'taycan saloon',
     'odometer': 11833,
     'odometer_in_km': 19043,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-11-01',
     'sanitized_make': 'porsche',
     'seller_name': 'zenith',
     'title': 'porsche taycan saloon 420kw 4s 93kwh 4dr auto [5 seat]',
     'transmission': 'automatic',
     'trim': '420kw 4s 93kwh 4dr auto [5 seat]',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '3c428a25-5baa-5e42-8e6d-7c725817374e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LV73MGY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116383281',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PORSCHE',
 'model': 'TAYCAN SALOON',
 'odometer': 11833,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-01',
 'seller_name': 'Zenith',
 'title': 'PORSCHE TAYCAN SALOON 420kW 4S 93kWh 4dr Auto [5 Seat]',
 'transmission': 'automatic',
 'trim': '420kW 4S 93kWh 4dr Auto [5 Seat]',
 'vin': None,
 'year': 2023}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116383281%27 HTTP/1.1" 200 None
2025-11-27 19:00:36 [astonbarclay.gb] INFO: Saving data for 116383281: {'auction_closing_time': 1764323100.0, 'created_time': 1762888188.303121, 'last_price_update_time': 1764270036.741143}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116383281') HTTP/1.1" 204 0
2025-11-27 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 87f0b638-ab26-53b3-b453-74de3f7e0051 with identifier: 116809736
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 87f0b638-ab26-53b3-b453-74de3f7e0051 with identifier: 116809736
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'polestar 2 fastback 170kw 69kwh standard range sm [plus] 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 24573, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-15', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116809736', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '170kw 69kwh standard range sm [plus] 5dr auto', 'license_plate': 'oe72mtj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '87f0b638-ab26-53b3-b453-74de3f7e0051', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 39546}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '87f0b638-ab26-53b3-b453-74de3f7e0051',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe72mtj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116809736',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 24573,
     'odometer_in_km': 39546,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-15',
     'sanitized_make': 'polestar',
     'seller_name': 'zenith',
     'title': 'polestar 2 fastback 170kw 69kwh standard range sm [plus] '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '170kw 69kwh standard range sm [plus] 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 87f0b638-ab26-53b3-b453-74de3f7e0051 spider: astonbarclay.gb
2025-11-27 19:00:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 87f0b638-ab26-53b3-b453-74de3f7e0051 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'polestar 2 fastback 170kw 69kwh standard range sm [plus] 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 24573, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-15', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116809736', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '170kw 69kwh standard range sm [plus] 5dr auto', 'license_plate': 'oe72mtj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '87f0b638-ab26-53b3-b453-74de3f7e0051', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 39546}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '87f0b638-ab26-53b3-b453-74de3f7e0051',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe72mtj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116809736',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 24573,
     'odometer_in_km': 39546,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-15',
     'sanitized_make': 'polestar',
     'seller_name': 'zenith',
     'title': 'polestar 2 fastback 170kw 69kwh standard range sm [plus] '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '170kw 69kwh standard range sm [plus] 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '87f0b638-ab26-53b3-b453-74de3f7e0051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OE72MTJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116809736',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'POLESTAR',
 'model': '2 FASTBACK',
 'odometer': 24573,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-15',
 'seller_name': 'Zenith',
 'title': 'POLESTAR 2 FASTBACK 170kW 69kWh Standard Range SM [Plus] 5dr Auto',
 'transmission': 'automatic',
 'trim': '170kW 69kWh Standard Range SM [Plus] 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116809736%27 HTTP/1.1" 200 None
2025-11-27 19:00:36 [astonbarclay.gb] INFO: Saving data for 116809736: {'auction_closing_time': 1764323100.0, 'created_time': 1763492906.346608, 'last_price_update_time': 1764270036.953313}
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116809736') HTTP/1.1" 204 0
2025-11-27 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: de5f468f-b0e4-5de0-89ba-597f571e4a41 with identifier: 117019889
2025-11-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: de5f468f-b0e4-5de0-89ba-597f571e4a41 with identifier: 117019889
2025-11-27 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: de5f468f-b0e4-5de0-89ba-597f571e4a41 with identifier: 117019889 to the API
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117019889?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'de5f468f-b0e4-5de0-89ba-597f571e4a41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV71EDL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117019889',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'IONIQ HATCHBACK',
 'odometer': 34422,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI IONIQ HATCHBACK 1.6 GDi Hybrid Premium 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6 GDi Hybrid Premium 5dr DCT',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019889%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Saving data for 117019889: {'auction_closing_time': 1764323100.0, 'created_time': 1764147728.929025, 'last_price_update_time': 1764270037.271618}
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117019889') HTTP/1.1" 204 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117144960
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144960%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117144960: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117144969
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144969%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117144969: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117422415
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422415%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117422415: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117407486
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407486%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117407486: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117407455
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407455%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117407455: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 116997220
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997220%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 116997220: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117421105
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421105%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117421105: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 116997154
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997154%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 116997154: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 116997182
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997182%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 116997182: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117407792
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407792%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117407792: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117316150
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316150%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117316150: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117122763
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117122763%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117122763: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117316133
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316133%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117316133: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117268826
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117268826%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117268826: 2
2025-11-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117112542?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117213978
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213978%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117213978: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117269311
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269311%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117269311: 2
2025-11-27 19:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 116872991
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116872991%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 116872991: 2
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117405574
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405574%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117405574: 2
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117405473
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405473%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117405473: 2
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117457825
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457825%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117457825: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117457816
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457816%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117457816: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117397605
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397605%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117397605: 0
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117207188
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117207188: 2
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117112542, 'registration': 'YC71MWV', 'account': 'ZEN009', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 Mild hybrid 140 R.S. Line 5dr', 'mileage': 9761, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 112, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC71MWV/2025-11-19/image/1c6823c6-10d7-4cf9-a051-93a7463d3390_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/304e1d35-6258-4301-9a72-f98285d1da4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/8885123e-dc3a-48a1-a247-365b5a6f3d17_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/900b07b5-8f30-4148-9f15-034680cc63a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/04ed19a4-a787-4a93-afdc-807021d2b5a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/97bfe147-20ae-49f5-bc27-b4606e7c274e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/a1aaa8fa-f1d9-4e73-b9b2-8dbe678b3d7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/900951a8-2d6f-4e19-9626-aa2956310584_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/f80612ed-0b5a-48ae-a1fe-c8d8d0cbb947_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/23- 4K, 05/24- 6K, 05/25 8K', 'remarks': '**983**VOSA STATES 8K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/55ff4df4-2b47-49b5-b323-6707fd8f53a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117112542, 'registration': 'YC71MWV', 'account': 'ZEN009', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 Mild hybrid 140 R.S. Line 5dr', 'mileage': 9761, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 112, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC71MWV/2025-11-19/image/1c6823c6-10d7-4cf9-a051-93a7463d3390_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/304e1d35-6258-4301-9a72-f98285d1da4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/8885123e-dc3a-48a1-a247-365b5a6f3d17_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/900b07b5-8f30-4148-9f15-034680cc63a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/04ed19a4-a787-4a93-afdc-807021d2b5a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/97bfe147-20ae-49f5-bc27-b4606e7c274e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/a1aaa8fa-f1d9-4e73-b9b2-8dbe678b3d7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/900951a8-2d6f-4e19-9626-aa2956310584_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC71MWV/2025-11-19/image/f80612ed-0b5a-48ae-a1fe-c8d8d0cbb947_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/23- 4K, 05/24- 6K, 05/25 8K', 'remarks': '**983**VOSA STATES 8K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/55ff4df4-2b47-49b5-b323-6707fd8f53a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047861fe-c048-570d-a4f2-bce80a5ddb3f with identifier: 117112542
2025-11-27 19:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047861fe-c048-570d-a4f2-bce80a5ddb3f with scrape type 2
2025-11-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047861fe-c048-570d-a4f2-bce80a5ddb3f with scrape type 2
2025-11-27 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 047861fe-c048-570d-a4f2-bce80a5ddb3f, identifier: 117112542
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117207172
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-11-27 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117207172: 2
2025-11-27 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 047861fe-c048-570d-a4f2-bce80a5ddb3f with identifier: 117112542
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED%2FBLACK HTTP/1.1" 200 None
2025-11-27 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 047861fe-c048-570d-a4f2-bce80a5ddb3f with identifier: 117112542
2025-11-27 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 047861fe-c048-570d-a4f2-bce80a5ddb3f with identifier: 117112542 to the API
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117112542?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '047861fe-c048-570d-a4f2-bce80a5ddb3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YC71MWV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117112542',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 9761,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seller_name': 'Zenith',
 'title': 'RENAULT CAPTUR HATCHBACK 1.3 Mild hybrid 140 R.S. Line 5dr',
 'transmission': 'manual',
 'trim': '1.3 Mild hybrid 140 R.S. Line 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117112542%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Saving data for 117112542: {'auction_closing_time': 1764323100.0, 'created_time': 1764147729.345421, 'last_price_update_time': 1764270038.21639}
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117112542') HTTP/1.1" 204 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117372675, 'registration': 'OE22MVT', 'account': 'ZEN009', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '165kW 64kWh Standard Range Single motor 5dr Auto', 'mileage': 35469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 138, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-27', 'fuel': 'Electric', 'motExpiry': '2026-06-26', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**802**VOSA STATES 32K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e943009-1d5d-46a4-9b49-a9d08a2795d3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117372675, 'registration': 'OE22MVT', 'account': 'ZEN009', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '165kW 64kWh Standard Range Single motor 5dr Auto', 'mileage': 35469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 138, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-06-27', 'fuel': 'Electric', 'motExpiry': '2026-06-26', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**802**VOSA STATES 32K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e943009-1d5d-46a4-9b49-a9d08a2795d3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff30395e-c4b6-586d-9d9b-312820f1a625 with identifier: 117372675
2025-11-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff30395e-c4b6-586d-9d9b-312820f1a625 with scrape type 1
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117274456, 'registration': 'YH71XFK', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'UP ELECTRIC HATCHBACK', 'derivative': '60kW E-Up 32kWh 5dr Auto', 'mileage': 22957, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 137, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-10', 'fuel': 'Electric', 'motExpiry': '2025-11-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 19K', 'remarks': '**1653** VOSA STATES 19K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5979140d-8acf-4999-a363-159218c395ae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117274456, 'registration': 'YH71XFK', 'account': 'ZEN002', 'make': 'VOLKSWAGEN', 'model': 'UP ELECTRIC HATCHBACK', 'derivative': '60kW E-Up 32kWh 5dr Auto', 'mileage': 22957, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 137, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-10', 'fuel': 'Electric', 'motExpiry': '2025-11-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 19K', 'remarks': '**1653** VOSA STATES 19K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5979140d-8acf-4999-a363-159218c395ae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e89d2341-6d61-5d14-92f3-065fa0676120 with identifier: 117274456
2025-11-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89d2341-6d61-5d14-92f3-065fa0676120 with scrape type 1
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117397707
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397707%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117397707: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117397751
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397751%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117397751: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117269007
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269007%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117269007: 2
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117426410
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426410%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117426410: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117397685
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397685%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117397685: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117405681
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405681%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117405681: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 116792783
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116792783%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 116792783: 2
2025-11-27 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 112756773
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27112756773%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 112756773: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 116611908
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116611908%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 116611908: 2
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fbb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252Fa8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 116888595
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116888595%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 116888595: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117051861
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117051861%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117051861: 0
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117231987
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117231987%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117231987: 2
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117260206, 'registration': 'MT71TGO', 'account': 'ZEN009', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 32128, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 143, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-03', 'fuel': 'Electric', 'motExpiry': '2026-12-03', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MT71TGO/2025-11-27/image/51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/af7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**810**VOSA STATES 25K, 32K  SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b13dc785-eba1-4829-8a8a-e375b5e210a0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117260206, 'registration': 'MT71TGO', 'account': 'ZEN009', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 32128, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 143, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-03', 'fuel': 'Electric', 'motExpiry': '2026-12-03', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MT71TGO/2025-11-27/image/51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/af7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**810**VOSA STATES 25K, 32K  SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b13dc785-eba1-4829-8a8a-e375b5e210a0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2910a99b-7c30-572e-bf19-b9f7d54f0c90 with identifier: 117260206
2025-11-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90 with scrape type 1
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117491214, 'registration': 'SN71VCZ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW Sport 80kWh 5dr Auto', 'mileage': 64201, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 145, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-07', 'fuel': 'Electric', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 15K, 12/23 - 28K, 10/24 - 43K, 07/25 - 58K', 'remarks': '**960**VOSA STATES 47K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3247b6cd-1822-46d4-9541-c9e2b140b329.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117491214, 'registration': 'SN71VCZ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW Sport 80kWh 5dr Auto', 'mileage': 64201, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 145, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-07', 'fuel': 'Electric', 'motExpiry': '2025-12-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600', 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 15K, 12/23 - 28K, 10/24 - 43K, 07/25 - 58K', 'remarks': '**960**VOSA STATES 47K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3247b6cd-1822-46d4-9541-c9e2b140b329.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f327b62c-8ae3-540a-a75b-0cad22be2279 with identifier: 117491214
2025-11-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f327b62c-8ae3-540a-a75b-0cad22be2279 with scrape type 1
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117521004, 'registration': 'DP21HGD', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]', 'mileage': 70693, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 144, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-05', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DP21HGD/2025-11-26/image/ed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/b607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg?w=600'], 'colour': 'BLUE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 02/23 - 22K, 06/24 - 45K, 10/25 - 67K', 'remarks': '**827**VOSA STATES 45K, 63K Enigmatic Black SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/110ab0c3-dcb5-4650-932f-fe78c95f964f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117521004, 'registration': 'DP21HGD', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]', 'mileage': 70693, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 144, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-07-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-05', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DP21HGD/2025-11-26/image/ed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/b607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg?w=600'], 'colour': 'BLUE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 02/23 - 22K, 06/24 - 45K, 10/25 - 67K', 'remarks': '**827**VOSA STATES 45K, 63K Enigmatic Black SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/110ab0c3-dcb5-4650-932f-fe78c95f964f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 with identifier: 117521004
2025-11-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 with scrape type 1
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Fed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/ed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117355965, 'registration': 'DV22YMW', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 5317, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 142, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV22YMW/2025-11-26/image/fbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/b20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/07f194e1-a943-44e3-9298-dca268526367_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/cf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/c03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/24- 2K, 04/25- 4K', 'remarks': '**717**VOSA STATES 4K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/249ccdc7-4a43-48f3-b2e9-90d4d0793889.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117355965, 'registration': 'DV22YMW', 'account': 'ZEN009', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi SE Connect 5dr 2WD', 'mileage': 5317, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 142, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV22YMW/2025-11-26/image/fbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/b20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/07f194e1-a943-44e3-9298-dca268526367_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/cf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/c03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/24- 2K, 04/25- 4K', 'remarks': '**717**VOSA STATES 4K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/249ccdc7-4a43-48f3-b2e9-90d4d0793889.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a467cd0f-4a93-5513-9d5a-9e6f47614eb7 with identifier: 117355965
2025-11-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7 with scrape type 1
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Ffbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/fbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 116943613
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116943613%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Scrape type for 116943613: 2
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252Fa9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117209835, 'registration': 'BF73UZU', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto', 'mileage': 28164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 141, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-12-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 16K', 'remarks': '**876** Pearl Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9f0e6bf-b569-425d-88de-644db595a4b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117209835, 'registration': 'BF73UZU', 'account': 'ZEN002', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto', 'mileage': 28164, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 141, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-12-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 16K', 'remarks': '**876** Pearl Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f9f0e6bf-b569-425d-88de-644db595a4b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835
2025-11-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with scrape type 1
2025-11-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117238091
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238091%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117238091: 0
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 114912508
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114912508%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 114912508: 2
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Faad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Fb20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/b20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fc3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117322438
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117322438%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117322438: 2
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Faa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F07f194e1-a943-44e3-9298-dca268526367_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/07f194e1-a943-44e3-9298-dca268526367_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Feb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252Fc4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 116258586
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116258586%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 116258586: 2
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252Fd683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117169329?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117213305
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213305%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117213305: 0
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117207910
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207910%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117207910: 2
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Fb607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/b607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fd3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fe9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117217494
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217494%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117217494: 0
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 116744851
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116744851%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Scrape type for 116744851: 2
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252Faf7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/af7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252Fa5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Fcf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/cf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117169329, 'registration': 'SK72EJA', 'account': 'OGI001', 'make': 'KIA', 'model': 'NIRO EV ESTATE', 'derivative': '150kW 2 65kWh 5dr Auto', 'mileage': 66242, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 173, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-12', 'fuel': 'Electric', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK72EJA/2025-11-18/image/77a7d168-18fc-4448-90b7-ff4678cb8a56_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/5831d27c-2539-418b-a337-106265d4e36d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/7a7ba51a-e63f-4e84-a15d-7083d25300cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/c0e22e8d-a506-4d2a-900f-4e2b4751c852_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/31c078be-6a7c-4ce8-8e4c-cadec82162a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/64eca1c7-a3ee-446c-a134-5116aec4fa35_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/c9766887-daa5-4cd0-9bab-d6a87d20940b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/cde6db82-70a4-4a39-b12d-0ac875a694bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/aef72003-fd82-430a-bda7-1a975f4f1f96_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23- 26K, 10/24- 47K, 10/25-66K', 'remarks': '**1415**Ex-Private Hire  CHARGING CABLE', 'virtual': False, 'seller': 'Ogilvie Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a089a2cc-d239-4503-9d6f-9baea1fae8ef.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117169329, 'registration': 'SK72EJA', 'account': 'OGI001', 'make': 'KIA', 'model': 'NIRO EV ESTATE', 'derivative': '150kW 2 65kWh 5dr Auto', 'mileage': 66242, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 173, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-12', 'fuel': 'Electric', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK72EJA/2025-11-18/image/77a7d168-18fc-4448-90b7-ff4678cb8a56_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/5831d27c-2539-418b-a337-106265d4e36d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/7a7ba51a-e63f-4e84-a15d-7083d25300cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/c0e22e8d-a506-4d2a-900f-4e2b4751c852_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/31c078be-6a7c-4ce8-8e4c-cadec82162a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/64eca1c7-a3ee-446c-a134-5116aec4fa35_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/c9766887-daa5-4cd0-9bab-d6a87d20940b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/cde6db82-70a4-4a39-b12d-0ac875a694bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72EJA/2025-11-18/image/aef72003-fd82-430a-bda7-1a975f4f1f96_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23- 26K, 10/24- 47K, 10/25-66K', 'remarks': '**1415**Ex-Private Hire  CHARGING CABLE', 'virtual': False, 'seller': 'Ogilvie Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a089a2cc-d239-4503-9d6f-9baea1fae8ef.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42aef619-be66-541c-bc4c-48febd2a36d8 with identifier: 117169329
2025-11-27 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42aef619-be66-541c-bc4c-48febd2a36d8 with scrape type 2
2025-11-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42aef619-be66-541c-bc4c-48febd2a36d8 with scrape type 2
2025-11-27 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 42aef619-be66-541c-bc4c-48febd2a36d8, identifier: 117169329
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116763299, 'registration': 'YM23WUT', 'account': 'ZEN002', 'make': 'MINI', 'model': 'HATCHBACK ELECTRIC', 'derivative': '135kW Cooper S Level 3 33kWh 3dr Auto', 'mileage': 7084, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 156, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 3, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 08/25 - 6K', 'remarks': '**990** British Racing Green SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59017e5a-fa33-4525-971b-8bdb40f606fa.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116763299, 'registration': 'YM23WUT', 'account': 'ZEN002', 'make': 'MINI', 'model': 'HATCHBACK ELECTRIC', 'derivative': '135kW Cooper S Level 3 33kWh 3dr Auto', 'mileage': 7084, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 156, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-20', 'fuel': 'Electric', 'motExpiry': None, 'doors': 3, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 08/25 - 6K', 'remarks': '**990** British Racing Green SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59017e5a-fa33-4525-971b-8bdb40f606fa.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 381ae8de-d0f2-5e40-9f7a-83282541e764 with identifier: 116763299
2025-11-27 19:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 381ae8de-d0f2-5e40-9f7a-83282541e764 with scrape type 1
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Fba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117411712, 'registration': 'VN71WCD', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh Sport 5dr Auto [C+S]', 'mileage': 37769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 155, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-10', 'fuel': 'Electric', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 20K', 'remarks': '**743**VOSA STATES 28K, 36K Intr Pckg For Frnt Sprt Sts In Twin Lthr; Metallic Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a908bad-3f1e-4e0d-b3f0-6d90d8863cae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117411712, 'registration': 'VN71WCD', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh Sport 5dr Auto [C+S]', 'mileage': 37769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 155, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-10', 'fuel': 'Electric', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 20K', 'remarks': '**743**VOSA STATES 28K, 36K Intr Pckg For Frnt Sprt Sts In Twin Lthr; Metallic Paint SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8a908bad-3f1e-4e0d-b3f0-6d90d8863cae.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2fb09a9-029b-5eab-ae02-9631ac546b3d with identifier: 117411712
2025-11-27 19:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2fb09a9-029b-5eab-ae02-9631ac546b3d with scrape type 1
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252F4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117024793
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024793%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117024793: 2
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fcfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 42aef619-be66-541c-bc4c-48febd2a36d8 with identifier: 117169329
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 42aef619-be66-541c-bc4c-48febd2a36d8 with identifier: 117169329
2025-11-27 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'ogilvie fleet', 'price_includes_vat': False, 'title': 'kia niro ev estate 150kw 2 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'niro ev estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 66242, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117169329', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 2 65kwh 5dr auto', 'license_plate': 'sk72eja', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '42aef619-be66-541c-bc4c-48febd2a36d8', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'kia niro ev estate', 'sanitized_make': 'kia', 'odometer_in_km': 106605} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '42aef619-be66-541c-bc4c-48febd2a36d8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sk72eja',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117169329',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'kia',
     'make_model': 'kia niro ev estate',
     'model': 'niro ev estate',
     'odometer': 66242,
     'odometer_in_km': 106605,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-12',
     'sanitized_make': 'kia',
     'seller_name': 'ogilvie fleet',
     'title': 'kia niro ev estate 150kw 2 65kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 2 65kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 42aef619-be66-541c-bc4c-48febd2a36d8 spider: astonbarclay.gb
2025-11-27 19:00:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 42aef619-be66-541c-bc4c-48febd2a36d8 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'ogilvie fleet', 'price_includes_vat': False, 'title': 'kia niro ev estate 150kw 2 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'niro ev estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 66242, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117169329', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 2 65kwh 5dr auto', 'license_plate': 'sk72eja', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '42aef619-be66-541c-bc4c-48febd2a36d8', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'kia niro ev estate', 'sanitized_make': 'kia', 'odometer_in_km': 106605} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '42aef619-be66-541c-bc4c-48febd2a36d8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sk72eja',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117169329',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'kia',
     'make_model': 'kia niro ev estate',
     'model': 'niro ev estate',
     'odometer': 66242,
     'odometer_in_km': 106605,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-12',
     'sanitized_make': 'kia',
     'seller_name': 'ogilvie fleet',
     'title': 'kia niro ev estate 150kw 2 65kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 2 65kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '42aef619-be66-541c-bc4c-48febd2a36d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SK72EJA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117169329',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'KIA',
 'model': 'NIRO EV ESTATE',
 'odometer': 66242,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seller_name': 'Ogilvie Fleet',
 'title': 'KIA NIRO EV ESTATE 150kW 2 65kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 2 65kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117169329%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Saving data for 117169329: {'auction_closing_time': 1764323100.0, 'created_time': 1763492857.032934, 'last_price_update_time': 1764270040.633699}
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117169329') HTTP/1.1" 204 0
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Ff1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fb26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117387336
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117387336%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117387336: 0
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 116879729
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116879729%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Scrape type for 116879729: 0
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117291795
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117291795%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117291795: 0
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117195971
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195971%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117195971: 2
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Fc03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/c03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117175584?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117440690?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117289360?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117123611?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd02790>
2025-11-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea053d0>
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea1f090>
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fa3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117440649?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117083405
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117083405%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117083405: 2
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fe5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252F36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117232230
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117232230%27 HTTP/1.1" 200 None
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117232230: 0
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117425815
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425815%27 HTTP/1.1" 200 None
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117425815: 0
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117030022
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030022%27 HTTP/1.1" 200 None
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117030022: 2
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fe10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117175584, 'registration': 'YE20USZ', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X 5dr', 'mileage': 53373, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 12, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff6a0a32-e9c9-48f9-8710-82bda23066bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/9bf0b407-f58b-4abf-a04b-8a33e6ceb70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff1700f9-12fb-42f6-aca3-54246badf853_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/3b4db2be-395b-4c00-aa88-7b5b16e8dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/f946f23e-9f36-4724-9f67-cf4655ff471c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/21dbc6dd-427b-46c3-873a-d91784820ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/db73a3c7-ed7d-450f-b021-a27fe9c755b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/75be46ea-911b-421b-abf8-bcdd230148a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/6dbd76d3-010b-407e-b8fb-5af132f6661a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/2fc890e8-a8ea-4103-9ad3-5ec93b6d9f39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 9K 07/24 29K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9276b3bc-ebf2-44a9-9fa5-1d7c85672c41.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117175584, 'registration': 'YE20USZ', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X 5dr', 'mileage': 53373, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 12, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff6a0a32-e9c9-48f9-8710-82bda23066bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/9bf0b407-f58b-4abf-a04b-8a33e6ceb70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff1700f9-12fb-42f6-aca3-54246badf853_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/3b4db2be-395b-4c00-aa88-7b5b16e8dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/f946f23e-9f36-4724-9f67-cf4655ff471c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/21dbc6dd-427b-46c3-873a-d91784820ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/db73a3c7-ed7d-450f-b021-a27fe9c755b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/75be46ea-911b-421b-abf8-bcdd230148a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/6dbd76d3-010b-407e-b8fb-5af132f6661a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/2fc890e8-a8ea-4103-9ad3-5ec93b6d9f39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 9K 07/24 29K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9276b3bc-ebf2-44a9-9fa5-1d7c85672c41.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-11-27 19:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910f4a33-d3b5-573d-a08f-06650114b76d with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910f4a33-d3b5-573d-a08f-06650114b76d with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 910f4a33-d3b5-573d-a08f-06650114b76d, identifier: 117175584
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117440690, 'registration': 'SO19CYF', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'I800 DIESEL ESTATE', 'derivative': '2.5 CRDi SE Nav 5dr', 'mileage': 85554, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 8, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 2497, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/a95a7948-2d4b-45a1-82d0-f4683bfa26f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/afde87ce-3d30-4e4c-aca5-170fcccf9cf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ca2285f1-376e-4277-829f-24a1a74770dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/005f9c80-ed26-4dd5-9889-bb9b8dc40f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/7e8262bf-8428-4153-825d-fbeffc9998b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/0480595d-c5e5-4167-ab3f-3537bc1c1a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ff5e7bce-9c77-49af-9bea-4be21f14b712_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/c4ee2993-ce41-48c7-977f-d4ca32e53527_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2 X SB 08/20 25K 08/21 45K 04/22 60K 10/23 70K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 222, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e6b2d25-d8e4-4dc6-a7c8-229f77d460c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117440690, 'registration': 'SO19CYF', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'I800 DIESEL ESTATE', 'derivative': '2.5 CRDi SE Nav 5dr', 'mileage': 85554, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 8, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 2497, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/a95a7948-2d4b-45a1-82d0-f4683bfa26f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/afde87ce-3d30-4e4c-aca5-170fcccf9cf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ca2285f1-376e-4277-829f-24a1a74770dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/005f9c80-ed26-4dd5-9889-bb9b8dc40f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/7e8262bf-8428-4153-825d-fbeffc9998b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/0480595d-c5e5-4167-ab3f-3537bc1c1a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ff5e7bce-9c77-49af-9bea-4be21f14b712_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/c4ee2993-ce41-48c7-977f-d4ca32e53527_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2 X SB 08/20 25K 08/21 45K 04/22 60K 10/23 70K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 222, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e6b2d25-d8e4-4dc6-a7c8-229f77d460c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-11-27 19:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0505eef-8935-5965-96f3-60a649d896ef with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0505eef-8935-5965-96f3-60a649d896ef with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b0505eef-8935-5965-96f3-60a649d896ef, identifier: 117440690
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117289360, 'registration': 'GF69HHM', 'account': 'KCS002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Active 5dr', 'mileage': 71629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 6, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF69HHM/2025-11-19/image/1a2dd15f-507a-4089-8e3e-d33a62dde49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/47bff8ab-5d6c-43bd-ba90-1949281f76a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/e910b2a3-b0a6-4a6b-a1c0-94f41a4b3240_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a6a8f082-8492-4e04-ba9c-bd42e5b54df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a2cbdb09-b11f-4beb-8d74-52710d1642f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8239aebf-a648-43af-89fe-9b669be696a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8fa1ade3-8646-4e29-8792-dfc81efac79d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/f272f34c-eb38-48d1-bd76-98c6ba235e11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/4ddebdb7-250c-4b2e-8b06-745505853fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/b8ff893f-42a4-4400-91b4-4098fcaa4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/ce91928d-a13d-4889-8b14-e2b1aae7a8d6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/21 18K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9b1822-37b2-4035-81a7-8edafbd4b9b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117289360, 'registration': 'GF69HHM', 'account': 'KCS002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Active 5dr', 'mileage': 71629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 6, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF69HHM/2025-11-19/image/1a2dd15f-507a-4089-8e3e-d33a62dde49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/47bff8ab-5d6c-43bd-ba90-1949281f76a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/e910b2a3-b0a6-4a6b-a1c0-94f41a4b3240_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a6a8f082-8492-4e04-ba9c-bd42e5b54df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a2cbdb09-b11f-4beb-8d74-52710d1642f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8239aebf-a648-43af-89fe-9b669be696a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8fa1ade3-8646-4e29-8792-dfc81efac79d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/f272f34c-eb38-48d1-bd76-98c6ba235e11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/4ddebdb7-250c-4b2e-8b06-745505853fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/b8ff893f-42a4-4400-91b4-4098fcaa4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/ce91928d-a13d-4889-8b14-e2b1aae7a8d6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/21 18K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9b1822-37b2-4035-81a7-8edafbd4b9b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-11-27 19:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839, identifier: 117289360
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117123611, 'registration': 'WA66VEH', 'account': 'MER023', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel TSS 5dr CVT', 'mileage': 51049, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 10, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-02', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WA66VEH/2025-11-12/image/ac6cd81d-5d2f-4688-879e-6ba8bab42e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/6f50a6f9-75e5-4038-9b4d-f87c6220cd10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d2d9b5e3-d975-4498-9456-17b5eb68bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3db2d2a4-7f26-4188-8ace-99d4c4391b10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/2370c42d-2583-4c08-9b29-d38da6aa6b37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/52db6d09-e166-40f0-9823-22bad00d955c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3af56105-8e0a-4772-8ee8-d43cbfb9d903_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/abbf0ad8-0cdb-4c55-8c37-09a6c215e8a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/7d0a08b8-7e74-4c29-b60b-40de1b1be7dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d973d60b-a982-4c38-bebe-507a2103e702_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/33900aa9-2b51-4638-930e-61dd9d76d285_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 09/25 50K', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/302718e4-8618-455b-be8c-7893a498c9fe.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117123611, 'registration': 'WA66VEH', 'account': 'MER023', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel TSS 5dr CVT', 'mileage': 51049, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 10, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-02', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WA66VEH/2025-11-12/image/ac6cd81d-5d2f-4688-879e-6ba8bab42e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/6f50a6f9-75e5-4038-9b4d-f87c6220cd10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d2d9b5e3-d975-4498-9456-17b5eb68bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3db2d2a4-7f26-4188-8ace-99d4c4391b10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/2370c42d-2583-4c08-9b29-d38da6aa6b37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/52db6d09-e166-40f0-9823-22bad00d955c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3af56105-8e0a-4772-8ee8-d43cbfb9d903_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/abbf0ad8-0cdb-4c55-8c37-09a6c215e8a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/7d0a08b8-7e74-4c29-b60b-40de1b1be7dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d973d60b-a982-4c38-bebe-507a2103e702_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/33900aa9-2b51-4638-930e-61dd9d76d285_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 09/25 50K', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/302718e4-8618-455b-be8c-7893a498c9fe.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611
2025-11-27 19:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f0d085-784f-5505-aee0-1b2eac3fd35c with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f0d085-784f-5505-aee0-1b2eac3fd35c with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 87f0d085-784f-5505-aee0-1b2eac3fd35c, identifier: 117123611
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117440649, 'registration': 'SO17CRK', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 48372, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 7, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-23', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SO17CRK/2025-11-24/image/0bcf6513-a26d-4e31-b74f-2795fe1b8388_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/eceff26c-fe67-406c-9c17-0eac29bb3a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/243a4c7e-cf03-4cb9-801f-fe825965c687_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/a7bf0d57-d72a-44ec-9e55-08c7934f3c44_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/12366d04-2217-44bd-b0d1-d52c13e7347f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/6d8e7889-e47b-43af-a7ed-8d92364094ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/96756350-38e9-41e3-b030-113d1d52d173_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/8aa258c9-5613-4605-b576-e4faf0f9670a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/13e9631f-84ad-4f79-a49e-f3b40e0f42ab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/18 8K 08/19 16K 08/20 23K 06/21 29K 06/22 34K 06/23 39K 07/24 42K 06/25 46K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ccde17e-936a-4a61-897b-c8b08677494c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117440649, 'registration': 'SO17CRK', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 48372, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 7, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-23', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SO17CRK/2025-11-24/image/0bcf6513-a26d-4e31-b74f-2795fe1b8388_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/eceff26c-fe67-406c-9c17-0eac29bb3a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/243a4c7e-cf03-4cb9-801f-fe825965c687_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/a7bf0d57-d72a-44ec-9e55-08c7934f3c44_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/12366d04-2217-44bd-b0d1-d52c13e7347f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/6d8e7889-e47b-43af-a7ed-8d92364094ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/96756350-38e9-41e3-b030-113d1d52d173_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/8aa258c9-5613-4605-b576-e4faf0f9670a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/13e9631f-84ad-4f79-a49e-f3b40e0f42ab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/18 8K 08/19 16K 08/20 23K 06/21 29K 06/22 34K 06/23 39K 07/24 42K 06/25 46K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ccde17e-936a-4a61-897b-c8b08677494c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649
2025-11-27 19:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d0e8942-083c-5a53-9327-d76572ff43bc with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d0e8942-083c-5a53-9327-d76572ff43bc with scrape type 2
2025-11-27 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d0e8942-083c-5a53-9327-d76572ff43bc, identifier: 117440649
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb86d10>
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fd3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd42490>
2025-11-27 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fe9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec33dd0>
2025-11-27 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/c03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117372886
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372886%27 HTTP/1.1" 200 None
2025-11-27 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117372886: 0
2025-11-27 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117233727
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117233727%27 HTTP/1.1" 200 None
2025-11-27 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117233727: 0
2025-11-27 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117123365
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123365%27 HTTP/1.1" 200 None
2025-11-27 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117123365: 2
2025-11-27 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-11-27 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-11-27 19:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584 to the API
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27910f4a33-d3b5-573d-a08f-06650114b76d%27 HTTP/1.1" 200 None
2025-11-27 19:00:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 910f4a33-d3b5-573d-a08f-06650114b76d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117175584?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '910f4a33-d3b5-573d-a08f-06650114b76d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YE20USZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117175584',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'FOCUS DIESEL ESTATE',
 'odometer': 53373,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-17',
 'seller_name': 'Wilsons',
 'title': 'FORD FOCUS DIESEL ESTATE 1.5 EcoBlue 120 Active X 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue 120 Active X 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-11-27 19:00:43 [astonbarclay.gb] INFO: Saving data for 117175584: {'auction_closing_time': 1764334800.0, 'created_time': 1763146933.810574, 'last_price_update_time': 1764270043.716164}
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117175584') HTTP/1.1" 204 0
2025-11-27 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-11-27 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-11-27 19:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690 to the API
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b0505eef-8935-5965-96f3-60a649d896ef%27 HTTP/1.1" 200 None
2025-11-27 19:00:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b0505eef-8935-5965-96f3-60a649d896ef: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117440690?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b0505eef-8935-5965-96f3-60a649d896ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SO19CYF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440690',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'HYUNDAI',
 'model': 'I800 DIESEL ESTATE',
 'odometer': 85554,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI I800 DIESEL ESTATE 2.5 CRDi SE Nav 5dr',
 'transmission': 'manual',
 'trim': '2.5 CRDi SE Nav 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-11-27 19:00:44 [astonbarclay.gb] INFO: Saving data for 117440690: {'auction_closing_time': 1764334800.0, 'created_time': 1763974953.893626, 'last_price_update_time': 1764270044.092364}
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117440690') HTTP/1.1" 204 0
2025-11-27 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-11-27 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-11-27 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360 to the API
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274d1d8a92-dc30-51b8-9ad1-5b7aba17c839%27 HTTP/1.1" 200 None
2025-11-27 19:00:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117289360?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4d1d8a92-dc30-51b8-9ad1-5b7aba17c839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF69HHM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117289360',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 71629,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Active 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Active 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-11-27 19:00:44 [astonbarclay.gb] INFO: Saving data for 117289360: {'auction_closing_time': 1764334800.0, 'created_time': 1763456563.337558, 'last_price_update_time': 1764270044.435461}
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117289360') HTTP/1.1" 204 0
2025-11-27 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611
2025-11-27 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611
2025-11-27 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611 to the API
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117123611?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '87f0d085-784f-5505-aee0-1b2eac3fd35c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WA66VEH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117123611',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'TOYOTA',
 'model': 'RAV4 ESTATE',
 'odometer': 51049,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-02',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'TOYOTA RAV4 ESTATE 2.5 VVT-i Hybrid Excel TSS 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 VVT-i Hybrid Excel TSS 5dr CVT',
 'vin': None,
 'year': 2016}
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123611%27 HTTP/1.1" 200 None
2025-11-27 19:00:44 [astonbarclay.gb] INFO: Saving data for 117123611: {'auction_closing_time': 1764334800.0, 'created_time': 1762974234.097236, 'last_price_update_time': 1764270044.799736}
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117123611') HTTP/1.1" 204 0
2025-11-27 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649
2025-11-27 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649
2025-11-27 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649 to the API
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278d0e8942-083c-5a53-9327-d76572ff43bc%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8d0e8942-083c-5a53-9327-d76572ff43bc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117440649?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8d0e8942-083c-5a53-9327-d76572ff43bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SO17CRK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440649',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 48372,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2017}
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440649%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [astonbarclay.gb] INFO: Saving data for 117440649: {'auction_closing_time': 1764334800.0, 'created_time': 1763974954.39675, 'last_price_update_time': 1764270045.241063}
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117440649') HTTP/1.1" 204 0
2025-11-27 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Faa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 117166263
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117166263%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [astonbarclay.gb] INFO: Scrape type for 117166263: 2
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fe3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 116890172
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116890172%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [astonbarclay.gb] INFO: Scrape type for 116890172: 0
2025-11-27 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 116759189
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116759189%27 HTTP/1.1" 200 None
2025-11-27 19:00:45 [astonbarclay.gb] INFO: Scrape type for 116759189: 2
2025-11-27 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd5690>
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb46a50>
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd28250>
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd2a650>
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Fc03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/c03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb56510>
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd2c390>
2025-11-27 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Fb22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252F7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117296291
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117296291%27 HTTP/1.1" 200 None
2025-11-27 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117296291: 2
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117268826?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117341295?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117269007?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Ffa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116639589?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd01b50>
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fb26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8febc1d0>
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Ff1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d41ef10>
2025-11-27 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:48 [astonbarclay.gb] INFO: Found listing with ID: 117209230
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209230%27 HTTP/1.1" 200 None
2025-11-27 19:00:48 [astonbarclay.gb] INFO: Scrape type for 117209230: 2
2025-11-27 19:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:48 [astonbarclay.gb] INFO: Found listing with ID: 116515726
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116515726%27 HTTP/1.1" 200 None
2025-11-27 19:00:48 [astonbarclay.gb] INFO: Scrape type for 116515726: 2
2025-11-27 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117195971?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3ccd0>
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252F36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd0e710>
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fe5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdeb810>
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:00:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117268826, 'registration': 'YN70PVF', 'account': 'ANG002', 'make': 'VOLVO', 'model': 'XC40 DIESEL ESTATE', 'derivative': '2.0 D3 Momentum 5dr Geartronic', 'mileage': 40903, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 82, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN70PVF/2025-11-18/image/39fa3f1d-6843-4137-b86c-a7f2e23cf3dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/67ed5e2a-f75d-4dcf-be6e-869e813a49ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0928159d-bc7e-44d8-bab7-484e291176e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/5479f724-3c23-4a27-ac46-f4d20852e1bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e841ce41-1798-4100-841e-fc3294eeb386_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/158180c4-9dbb-4fe1-be5b-73142804e26d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/7085626d-b1fd-4cb8-afa4-da2f99e372df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3876acf5-3fb9-4c9f-84e1-216a9bf8b4b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/8169df42-91fb-4361-b867-3d6ba683d648_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/00bebcc5-059b-413f-ae92-c7e8df50cf1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/b31bb996-1e9b-4764-8764-b917bb9ff1ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/53c2fc23-fa43-4135-b555-13c7728503bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0ebbe959-2e0e-4826-b8dc-29f356bdefa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e953d73c-f39a-4cd6-b11c-e3fbc2156e42_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/783402b7-bafe-4ce1-adc0-4dca47f7128c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3276aa89-3896-47ca-9b3a-5b97c1f8d938_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/963dee8d-07b9-474e-bae4-857e2ccd7f0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/656834ba-39a0-4198-98b8-9637658e6921_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/4d601409-38e2-47a0-83c2-a7d9b0c278d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/33b38c42-84a6-4e29-b4dc-95f95522e373_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa @ 36k 37k 40k', 'virtual': True, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31620af6-e1d9-4b8b-b868-fa9c3bb5b01b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117268826, 'registration': 'YN70PVF', 'account': 'ANG002', 'make': 'VOLVO', 'model': 'XC40 DIESEL ESTATE', 'derivative': '2.0 D3 Momentum 5dr Geartronic', 'mileage': 40903, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 82, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN70PVF/2025-11-18/image/39fa3f1d-6843-4137-b86c-a7f2e23cf3dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/67ed5e2a-f75d-4dcf-be6e-869e813a49ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0928159d-bc7e-44d8-bab7-484e291176e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/5479f724-3c23-4a27-ac46-f4d20852e1bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e841ce41-1798-4100-841e-fc3294eeb386_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/158180c4-9dbb-4fe1-be5b-73142804e26d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/7085626d-b1fd-4cb8-afa4-da2f99e372df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3876acf5-3fb9-4c9f-84e1-216a9bf8b4b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/8169df42-91fb-4361-b867-3d6ba683d648_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/00bebcc5-059b-413f-ae92-c7e8df50cf1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/b31bb996-1e9b-4764-8764-b917bb9ff1ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/53c2fc23-fa43-4135-b555-13c7728503bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/0ebbe959-2e0e-4826-b8dc-29f356bdefa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/e953d73c-f39a-4cd6-b11c-e3fbc2156e42_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/783402b7-bafe-4ce1-adc0-4dca47f7128c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/3276aa89-3896-47ca-9b3a-5b97c1f8d938_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/963dee8d-07b9-474e-bae4-857e2ccd7f0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/656834ba-39a0-4198-98b8-9637658e6921_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/4d601409-38e2-47a0-83c2-a7d9b0c278d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN70PVF/2025-11-18/image/33b38c42-84a6-4e29-b4dc-95f95522e373_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa @ 36k 37k 40k', 'virtual': True, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31620af6-e1d9-4b8b-b868-fa9c3bb5b01b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826
2025-11-27 19:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3c050f-9b41-5e6d-bccf-a592ef416561 with scrape type 2
2025-11-27 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b3c050f-9b41-5e6d-bccf-a592ef416561 with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5b3c050f-9b41-5e6d-bccf-a592ef416561, identifier: 117268826
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117341295, 'registration': 'MX68TGJ', 'account': 'MOT075', 'make': 'FORD', 'model': 'C-MAX ESTATE', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 13252, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 51, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-11', 'fuel': 'Petrol', 'motExpiry': '2025-10-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/d465a1e3-e835-43cd-b8b3-4c0e396edb76_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/395551b5-a3e2-403b-a8a1-6a4df90ed008_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/0ead0ce5-624c-4ca0-bcda-425901f2cd25_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/fd72d29f-819d-488c-a4be-3117ee5956da_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/7aab7b99-3322-40c0-8707-2f53d89847c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/efdc266a-6dd1-40cd-ac02-32dd1aa2188a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/d67a44b1-d416-4fe9-aaf5-0b181ec580bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/2b35f146-4ba6-47ae-a918-4d861bbd1420_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/20-3k, 11/22-8k,', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN, VOSA STATES 6K 8K 10K 13K, spare key', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58f08f58-a314-4c59-aac7-ca943c635286.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117341295, 'registration': 'MX68TGJ', 'account': 'MOT075', 'make': 'FORD', 'model': 'C-MAX ESTATE', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 13252, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 51, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-12-11', 'fuel': 'Petrol', 'motExpiry': '2025-10-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/d465a1e3-e835-43cd-b8b3-4c0e396edb76_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/395551b5-a3e2-403b-a8a1-6a4df90ed008_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/0ead0ce5-624c-4ca0-bcda-425901f2cd25_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/fd72d29f-819d-488c-a4be-3117ee5956da_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/7aab7b99-3322-40c0-8707-2f53d89847c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/efdc266a-6dd1-40cd-ac02-32dd1aa2188a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/d67a44b1-d416-4fe9-aaf5-0b181ec580bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MX68TGJ/2025-11-19/image/2b35f146-4ba6-47ae-a918-4d861bbd1420_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/20-3k, 11/22-8k,', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN, VOSA STATES 6K 8K 10K 13K, spare key', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58f08f58-a314-4c59-aac7-ca943c635286.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5 with identifier: 117341295
2025-11-27 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5 with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5 with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5, identifier: 117341295
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2006, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2006, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-11-27 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 92454ddf-1dc2-588e-b630-dd71f18ddd7a, identifier: 117207172
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117269007, 'registration': 'CK71ZPX', 'account': 'SPL001', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 67469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2010, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-12-01', 'fuel': 'Electric', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/03b15b99-6782-432a-b8a7-42b77874f028_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/edb210e6-1a7e-4585-9496-b50b8653533d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/d19eb372-ba87-4166-aedb-338ebea37aee_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/2a9875d3-68b1-4b9e-9789-64887c333c46_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/7d03e03d-8e8d-4e76-b3ea-65edb70ebd9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/89fd644a-8c55-49bd-9666-6b5a16fb8987_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/05a1e714-026b-4ced-878e-e72810191deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/4bfa236b-bc57-4b09-9f83-d1ffb5b46892_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/9ff6bba9-7748-4493-92c3-b9bc6450d0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/ed5c101a-143f-44bd-bd78-cce532b12b49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 9K, 02/23- 18K, 08/23- 28K, 05/24- 41K, 12/24- 50K, 02/25- 60K', 'remarks': 'VOSA STATES 40K, 50K, 50K, 67K,  SPARE KEY IN OFFICE, Ex-Private Hire', 'virtual': False, 'seller': 'Splend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bae2daba-b9ff-42b8-bb23-e42cccc895fc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117269007, 'registration': 'CK71ZPX', 'account': 'SPL001', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 67469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2010, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-12-01', 'fuel': 'Electric', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/03b15b99-6782-432a-b8a7-42b77874f028_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/edb210e6-1a7e-4585-9496-b50b8653533d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/d19eb372-ba87-4166-aedb-338ebea37aee_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/2a9875d3-68b1-4b9e-9789-64887c333c46_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/7d03e03d-8e8d-4e76-b3ea-65edb70ebd9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/89fd644a-8c55-49bd-9666-6b5a16fb8987_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/05a1e714-026b-4ced-878e-e72810191deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/4bfa236b-bc57-4b09-9f83-d1ffb5b46892_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/9ff6bba9-7748-4493-92c3-b9bc6450d0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK71ZPX/2025-11-20/image/ed5c101a-143f-44bd-bd78-cce532b12b49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 9K, 02/23- 18K, 08/23- 28K, 05/24- 41K, 12/24- 50K, 02/25- 60K', 'remarks': 'VOSA STATES 40K, 50K, 50K, 67K,  SPARE KEY IN OFFICE, Ex-Private Hire', 'virtual': False, 'seller': 'Splend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bae2daba-b9ff-42b8-bb23-e42cccc895fc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda96659-86d9-5adc-afc0-a49634bcaf5d with identifier: 117269007
2025-11-27 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda96659-86d9-5adc-afc0-a49634bcaf5d with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bda96659-86d9-5adc-afc0-a49634bcaf5d with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bda96659-86d9-5adc-afc0-a49634bcaf5d, identifier: 117269007
2025-11-27 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb629d0>
2025-11-27 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116639589, 'registration': 'FH16VBY', 'account': 'MOT075', 'make': 'AUDI', 'model': 'A4 AVANT', 'derivative': '2.0T FSI S Line 5dr S Tronic', 'mileage': 102226, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 52, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-05-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FH16VBY/2025-10-28/image/44d06914-32de-4ca9-aaaf-a3bc2bc827c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/d6fb8be9-179b-486f-a5f9-2055d380fea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/8bf98123-7b26-4938-8336-04eb533ed8cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/f69d0dbe-1259-4586-941e-c8328a33f3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/7273c405-ccc0-49ac-a533-acf1988d9877_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/cd04beae-13a7-421b-b204-ca7b1db35291_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/78d9cf7c-7bea-4324-9dde-9b6aa529c012_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/cfad74da-09aa-415c-a280-76d336c7b6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/0b6f7e43-ad88-4986-ac1d-da6c3c86255c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/8a4b97f2-ad54-4b9f-b02f-591eeda5d063_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/17-12K, 11/17-19K, 12/18-36K, 01/20-53K, 04/21-63K, 06/22-71K, 02/23-78K, 02/24-87K, 01/25-95K', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN,  SPARE KEY, VOSA STATES 43K 56K 63K 70K 80K 89K 96K', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c3bcf98-d763-45c9-8d63-4990f22144b1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116639589, 'registration': 'FH16VBY', 'account': 'MOT075', 'make': 'AUDI', 'model': 'A4 AVANT', 'derivative': '2.0T FSI S Line 5dr S Tronic', 'mileage': 102226, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 52, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-05-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FH16VBY/2025-10-28/image/44d06914-32de-4ca9-aaaf-a3bc2bc827c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/d6fb8be9-179b-486f-a5f9-2055d380fea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/8bf98123-7b26-4938-8336-04eb533ed8cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/f69d0dbe-1259-4586-941e-c8328a33f3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/7273c405-ccc0-49ac-a533-acf1988d9877_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/cd04beae-13a7-421b-b204-ca7b1db35291_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/78d9cf7c-7bea-4324-9dde-9b6aa529c012_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/cfad74da-09aa-415c-a280-76d336c7b6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/0b6f7e43-ad88-4986-ac1d-da6c3c86255c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH16VBY/2025-10-28/image/8a4b97f2-ad54-4b9f-b02f-591eeda5d063_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/17-12K, 11/17-19K, 12/18-36K, 01/20-53K, 04/21-63K, 06/22-71K, 02/23-78K, 02/24-87K, 01/25-95K', 'remarks': 'NUMBER OF FORMER KEEPERS UNKNOWN,  SPARE KEY, VOSA STATES 43K 56K 63K 70K 80K 89K 96K', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': {'siteId': '20846447', 'description': 'Aston Barclay Donington Park'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c3bcf98-d763-45c9-8d63-4990f22144b1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69a5840d-36e0-5028-87d6-4f8d4386e6ad with identifier: 116639589
2025-11-27 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69a5840d-36e0-5028-87d6-4f8d4386e6ad with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69a5840d-36e0-5028-87d6-4f8d4386e6ad with scrape type 2
2025-11-27 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 69a5840d-36e0-5028-87d6-4f8d4386e6ad, identifier: 116639589
2025-11-27 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Faf593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826
2025-11-27 19:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826
2025-11-27 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5b3c050f-9b41-5e6d-bccf-a592ef416561 with identifier: 117268826 to the API
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275b3c050f-9b41-5e6d-bccf-a592ef416561%27 HTTP/1.1" 200 None
2025-11-27 19:00:50 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5b3c050f-9b41-5e6d-bccf-a592ef416561: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:49 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117268826?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5b3c050f-9b41-5e6d-bccf-a592ef416561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YN70PVF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117268826',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VOLVO',
 'model': 'XC40 DIESEL ESTATE',
 'odometer': 40903,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seller_name': 'Local Dealer Group',
 'title': 'VOLVO XC40 DIESEL ESTATE 2.0 D3 Momentum 5dr Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D3 Momentum 5dr Geartronic',
 'vin': None,
 'year': 2020}
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117268826%27 HTTP/1.1" 200 None
2025-11-27 19:00:50 [astonbarclay.gb] INFO: Saving data for 117268826: {'auction_closing_time': 1764334800.0, 'created_time': 1763406113.753452, 'last_price_update_time': 1764270050.186865}
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117268826') HTTP/1.1" 204 0
2025-11-27 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5 with identifier: 117341295
2025-11-27 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5 with identifier: 117341295
2025-11-27 19:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5 with identifier: 117341295 to the API
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117341295?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ddcdd27e-7e2e-59f4-bc8d-b4327f32d3d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MX68TGJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117341295',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'C-MAX ESTATE',
 'odometer': 13252,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-11',
 'seller_name': 'MotoNovo Finance',
 'title': 'FORD C-MAX ESTATE 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117341295%27 HTTP/1.1" 200 None
2025-11-27 19:00:50 [astonbarclay.gb] INFO: Saving data for 117341295: {'auction_closing_time': 1764334800.0, 'created_time': 1763579117.130503, 'last_price_update_time': 1764270050.487992}
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117341295') HTTP/1.1" 204 0
2025-11-27 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-11-27 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-11-27 19:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172 to the API
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '92454ddf-1dc2-588e-b630-dd71f18ddd7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP68KPL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207172',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 66046,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'HONDA CR-V ESTATE 1.5 VTEC Turbo SR 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTEC Turbo SR 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-11-27 19:00:50 [astonbarclay.gb] INFO: Saving data for 117207172: {'auction_closing_time': 1764583200.0, 'created_time': 1763449278.224542, 'last_price_update_time': 1764270050.811696}
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207172') HTTP/1.1" 204 0
2025-11-27 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bda96659-86d9-5adc-afc0-a49634bcaf5d with identifier: 117269007
2025-11-27 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bda96659-86d9-5adc-afc0-a49634bcaf5d with identifier: 117269007
2025-11-27 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'splend', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 67469, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269007', 'expiration_date': '2025-12-01t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ck71zpx', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'bda96659-86d9-5adc-afc0-a49634bcaf5d', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 108580} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-01t10:00:00z',
     'fuel_type': 'electric',
     'id': 'bda96659-86d9-5adc-afc0-a49634bcaf5d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ck71zpx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269007',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 67469,
     'odometer_in_km': 108580,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-01',
     'sanitized_make': 'hyundai',
     'seller_name': 'splend',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-11-27 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: bda96659-86d9-5adc-afc0-a49634bcaf5d spider: astonbarclay.gb
2025-11-27 19:00:51 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: bda96659-86d9-5adc-afc0-a49634bcaf5d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'splend', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 67469, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269007', 'expiration_date': '2025-12-01t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ck71zpx', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'bda96659-86d9-5adc-afc0-a49634bcaf5d', 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 108580} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-01t10:00:00z',
     'fuel_type': 'electric',
     'id': 'bda96659-86d9-5adc-afc0-a49634bcaf5d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ck71zpx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269007',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 67469,
     'odometer_in_km': 108580,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-01',
     'sanitized_make': 'hyundai',
     'seller_name': 'splend',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'bda96659-86d9-5adc-afc0-a49634bcaf5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'CK71ZPX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269007',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'IONIQ ELECTRIC HATCHBACK',
 'odometer': 67469,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seller_name': 'Splend',
 'title': 'HYUNDAI IONIQ ELECTRIC HATCHBACK 100kW Premium 38kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Premium 38kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269007%27 HTTP/1.1" 200 None
2025-11-27 19:00:51 [astonbarclay.gb] INFO: Saving data for 117269007: {'auction_closing_time': 1764583200.0, 'created_time': 1763579126.643952, 'last_price_update_time': 1764270051.055642}
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117269007') HTTP/1.1" 204 0
2025-11-27 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 69a5840d-36e0-5028-87d6-4f8d4386e6ad with identifier: 116639589
2025-11-27 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 69a5840d-36e0-5028-87d6-4f8d4386e6ad with identifier: 116639589
2025-11-27 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164516 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164516
2025-11-27 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 69a5840d-36e0-5028-87d6-4f8d4386e6ad spider: astonbarclay.gb
2025-11-27 19:00:51 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 69a5840d-36e0-5028-87d6-4f8d4386e6ad due to rule: high_mileage_for_country.json, error: 164516 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164516
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '69a5840d-36e0-5028-87d6-4f8d4386e6ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FH16VBY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116639589',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 102226,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': 'MotoNovo Finance',
 'title': 'AUDI A4 AVANT 2.0T FSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0T FSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2016}
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116639589%27 HTTP/1.1" 200 None
2025-11-27 19:00:51 [astonbarclay.gb] INFO: Saving data for 116639589: {'auction_closing_time': 1764334800.0, 'created_time': 1763665341.761504, 'last_price_update_time': 1764270051.272443}
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116639589') HTTP/1.1" 204 0
2025-11-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:51 [astonbarclay.gb] INFO: Found listing with ID: 117022929
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022929%27 HTTP/1.1" 200 None
2025-11-27 19:00:51 [astonbarclay.gb] INFO: Scrape type for 117022929: 2
2025-11-27 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117030022?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117166263?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe30890>
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea9af90>
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea53390>
2025-11-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe31210>
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Faa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea47b90>
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fe3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117195971, 'registration': 'PJ72BYY', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 29809, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2719, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/38422e60-cf2e-4627-b2cd-32a97c1ecb51_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/80644599-3220-4da9-a33d-0d7795b04791_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/f879062f-d65b-4a7a-b67b-348606cbca92_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/f871ed6f-6dbf-4e21-85fc-52589c6e5405_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/475a02cc-37bf-42d6-8125-b0ba1ce162f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/12bade88-8641-4de8-a09a-d4dc93c00484_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/ccf78ad9-4a8f-4aab-bf20-4f26ea114bee_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/3f025dc8-93e0-4ebc-bdf7-64ec66c780a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/ebae5f9c-81bd-49a9-86ec-b0f7dc86e0e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/7a8601e7-82d4-480b-9c1a-fe8770019fea_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/23 8K - 10/24 18K', 'remarks': 'VOSA STATES 27K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/32970f1a-2df0-423b-b2eb-7033b93e6fd2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117195971, 'registration': 'PJ72BYY', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 29809, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2719, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/38422e60-cf2e-4627-b2cd-32a97c1ecb51_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/80644599-3220-4da9-a33d-0d7795b04791_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/f879062f-d65b-4a7a-b67b-348606cbca92_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/f871ed6f-6dbf-4e21-85fc-52589c6e5405_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/475a02cc-37bf-42d6-8125-b0ba1ce162f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/12bade88-8641-4de8-a09a-d4dc93c00484_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/ccf78ad9-4a8f-4aab-bf20-4f26ea114bee_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/3f025dc8-93e0-4ebc-bdf7-64ec66c780a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/ebae5f9c-81bd-49a9-86ec-b0f7dc86e0e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/PJ72BYY/2025-11-13/image/7a8601e7-82d4-480b-9c1a-fe8770019fea_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/23 8K - 10/24 18K', 'remarks': 'VOSA STATES 27K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/32970f1a-2df0-423b-b2eb-7033b93e6fd2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85536ee3-17d2-5580-bed7-1271f8083954 with identifier: 117195971
2025-11-27 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85536ee3-17d2-5580-bed7-1271f8083954 with scrape type 2
2025-11-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85536ee3-17d2-5580-bed7-1271f8083954 with scrape type 2
2025-11-27 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 85536ee3-17d2-5580-bed7-1271f8083954, identifier: 117195971
2025-11-27 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 116744389
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116744389%27 HTTP/1.1" 200 None
2025-11-27 19:00:52 [astonbarclay.gb] INFO: Scrape type for 116744389: 2
2025-11-27 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 85536ee3-17d2-5580-bed7-1271f8083954 with identifier: 117195971
2025-11-27 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 85536ee3-17d2-5580-bed7-1271f8083954 with identifier: 117195971
2025-11-27 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 85536ee3-17d2-5580-bed7-1271f8083954 with identifier: 117195971 to the API
2025-11-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117195971?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '85536ee3-17d2-5580-bed7-1271f8083954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PJ72BYY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117195971',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 29809,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117195971%27 HTTP/1.1" 200 None
2025-11-27 19:00:53 [astonbarclay.gb] INFO: Saving data for 117195971: {'auction_closing_time': 1764583200.0, 'created_time': 1763060593.344498, 'last_price_update_time': 1764270053.123826}
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195971') HTTP/1.1" 204 0
2025-11-27 19:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd10050>
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 116643961
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116643961%27 HTTP/1.1" 200 None
2025-11-27 19:00:53 [astonbarclay.gb] INFO: Scrape type for 116643961: 2
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117123365?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116759189?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3ec50>
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252F7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3e910>
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Fb22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec61910>
2025-11-27 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fe10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d4131d0>
2025-11-27 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117030022, 'registration': 'LL72JZN', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ALLSPACE ESTATE', 'derivative': '1.5 TSI Life 5dr DSG', 'mileage': 22493, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2723, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-08', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL72JZN/2025-11-10/image/4cf48a6f-1c1a-4dc9-a959-e6b9dd6b11c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/124249fc-424e-447b-b41d-56c84371446c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/5633629e-65d4-4034-9612-4fb79312045e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/442d0179-5706-4786-8c58-cc43468440bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/aac7be8d-0b1e-4d20-8de7-2ddbfd964354_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/3bbb81d7-61e3-46e7-9e85-3bc960a27c5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/e21c6f12-9a2c-4c08-ac70-d79cfa2f7575_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/a3c4d29e-380c-4d36-8a9a-ceaf1d9e5c65_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/68cf4e58-408a-4a48-ac27-ea0012f4853b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/eef38474-687d-48e2-94ca-a3318a441096_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/24 17K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc486cda-9293-4eda-a497-3705f96dc5d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117030022, 'registration': 'LL72JZN', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ALLSPACE ESTATE', 'derivative': '1.5 TSI Life 5dr DSG', 'mileage': 22493, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2723, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-08', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LL72JZN/2025-11-10/image/4cf48a6f-1c1a-4dc9-a959-e6b9dd6b11c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/124249fc-424e-447b-b41d-56c84371446c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/5633629e-65d4-4034-9612-4fb79312045e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/442d0179-5706-4786-8c58-cc43468440bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/aac7be8d-0b1e-4d20-8de7-2ddbfd964354_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/3bbb81d7-61e3-46e7-9e85-3bc960a27c5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/e21c6f12-9a2c-4c08-ac70-d79cfa2f7575_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/a3c4d29e-380c-4d36-8a9a-ceaf1d9e5c65_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/68cf4e58-408a-4a48-ac27-ea0012f4853b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL72JZN/2025-11-10/image/eef38474-687d-48e2-94ca-a3318a441096_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/24 17K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc486cda-9293-4eda-a497-3705f96dc5d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4693bbaf-3427-57cb-a263-d48b0e80e731 with identifier: 117030022
2025-11-27 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4693bbaf-3427-57cb-a263-d48b0e80e731 with scrape type 2
2025-11-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4693bbaf-3427-57cb-a263-d48b0e80e731 with scrape type 2
2025-11-27 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4693bbaf-3427-57cb-a263-d48b0e80e731, identifier: 117030022
2025-11-27 19:00:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117166263, 'registration': 'SA72DSX', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Excel 5dr CVT', 'mileage': 25478, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2727, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-06', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA72DSX/2025-11-13/image/c6b53110-7260-4cd4-b99f-40017cf5aa47_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/213672f3-7b15-4abe-b5f0-c87a977c80d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/c8411cd1-4a33-46c4-bdb0-0b1c71511c06_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/9052e3ca-7f44-490a-b503-2c2f516574b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/f46089f9-f96d-440a-97e5-0e0783955dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/13b8ece0-489c-4e68-9ff1-b159d3cd6c86_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/a985a6c9-8a4b-4dbf-9c52-e6d0bbedc5fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/99ea08df-143e-4714-b064-12ee6b257c67_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/74eff0d8-826b-4f07-9275-8c797e4dced1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/22b13f50-b9f9-41ba-a916-1bcefa544b7b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/23 4k - 10/24 14k', 'remarks': 'VOSA STATES, 24K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/72f72f8f-a5ca-43ee-8f72-4505baff0768.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117166263, 'registration': 'SA72DSX', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Excel 5dr CVT', 'mileage': 25478, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2727, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-06', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SA72DSX/2025-11-13/image/c6b53110-7260-4cd4-b99f-40017cf5aa47_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/213672f3-7b15-4abe-b5f0-c87a977c80d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/c8411cd1-4a33-46c4-bdb0-0b1c71511c06_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/9052e3ca-7f44-490a-b503-2c2f516574b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/f46089f9-f96d-440a-97e5-0e0783955dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/13b8ece0-489c-4e68-9ff1-b159d3cd6c86_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/a985a6c9-8a4b-4dbf-9c52-e6d0bbedc5fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/99ea08df-143e-4714-b064-12ee6b257c67_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/74eff0d8-826b-4f07-9275-8c797e4dced1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SA72DSX/2025-11-13/image/22b13f50-b9f9-41ba-a916-1bcefa544b7b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/23 4k - 10/24 14k', 'remarks': 'VOSA STATES, 24K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/72f72f8f-a5ca-43ee-8f72-4505baff0768.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d with identifier: 117166263
2025-11-27 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d with scrape type 2
2025-11-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d with scrape type 2
2025-11-27 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d, identifier: 117166263
2025-11-27 19:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4693bbaf-3427-57cb-a263-d48b0e80e731 with identifier: 117030022
2025-11-27 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4693bbaf-3427-57cb-a263-d48b0e80e731 with identifier: 117030022
2025-11-27 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4693bbaf-3427-57cb-a263-d48b0e80e731 with identifier: 117030022 to the API
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117030022?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4693bbaf-3427-57cb-a263-d48b0e80e731',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL72JZN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117030022',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE ESTATE',
 'odometer': 22493,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE ESTATE 1.5 TSI Life 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI Life 5dr DSG',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030022%27 HTTP/1.1" 200 None
2025-11-27 19:00:54 [astonbarclay.gb] INFO: Saving data for 117030022: {'auction_closing_time': 1764583200.0, 'created_time': 1763579027.331171, 'last_price_update_time': 1764270054.88706}
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117030022') HTTP/1.1" 204 0
2025-11-27 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d with identifier: 117166263
2025-11-27 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d with identifier: 117166263
2025-11-27 19:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d with identifier: 117166263 to the API
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275fe2ed75-f0c2-57f0-b32b-f6d383c4d89d%27 HTTP/1.1" 200 None
2025-11-27 19:00:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:00:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117166263?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '5fe2ed75-f0c2-57f0-b32b-f6d383c4d89d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SA72DSX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117166263',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'YARIS HATCHBACK',
 'odometer': 25478,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seller_name': 'Motability Operations',
 'title': 'TOYOTA YARIS HATCHBACK 1.5 Hybrid Excel 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid Excel 5dr CVT',
 'vin': None,
 'year': 2022}
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117166263%27 HTTP/1.1" 200 None
2025-11-27 19:00:55 [astonbarclay.gb] INFO: Saving data for 117166263: {'auction_closing_time': 1764583200.0, 'created_time': 1762974209.940896, 'last_price_update_time': 1764270055.236491}
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117166263') HTTP/1.1" 204 0
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 116798984
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116798984%27 HTTP/1.1" 200 None
2025-11-27 19:00:55 [astonbarclay.gb] INFO: Scrape type for 116798984: 2
2025-11-27 19:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117411712?view=catalogue)
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116763299?view=catalogue)
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117209230?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117083405?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117296291?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaa6810>
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Ffa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe3b150>
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252Fa3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe3b110>
2025-11-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb2e90>
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe3ae50>
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252F28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaa4050>
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Fcfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117123365, 'registration': 'OE19RKZ', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.6 PureTech 180 Allure 5dr EAT8', 'mileage': 43980, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2726, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-05-29', 'fuel': 'Petrol', 'motExpiry': '2026-09-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/9b73275e-e800-4a69-a1d6-f19ff5811182_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/647ab6f2-5f61-4076-97a3-0c1874af56b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/a25817e1-b396-4dbd-92fc-877f7fb3f3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/b5382b94-d5f7-4c0b-b9c8-abd595b2b21b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/308e016e-fb60-4db2-bf68-4a4ebd292724_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/769b9a45-4d46-45fd-b5ed-114d240c5ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/94490bba-4ca2-4c6a-ac80-4bc626f9cc62_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/aaa4806b-a845-4331-9c17-e4e8c11f47f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/7a7a08c2-8adb-4be7-8e3a-97edf339fcf0_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/24 32K', 'remarks': 'VOSA STATES, 20K, 24K, 32K, 43K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8d47490f-4e61-4992-8a9b-56213c8c9118.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117123365, 'registration': 'OE19RKZ', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.6 PureTech 180 Allure 5dr EAT8', 'mileage': 43980, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2726, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-05-29', 'fuel': 'Petrol', 'motExpiry': '2026-09-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/9b73275e-e800-4a69-a1d6-f19ff5811182_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/647ab6f2-5f61-4076-97a3-0c1874af56b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/a25817e1-b396-4dbd-92fc-877f7fb3f3ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/b5382b94-d5f7-4c0b-b9c8-abd595b2b21b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/308e016e-fb60-4db2-bf68-4a4ebd292724_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/769b9a45-4d46-45fd-b5ed-114d240c5ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/94490bba-4ca2-4c6a-ac80-4bc626f9cc62_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/aaa4806b-a845-4331-9c17-e4e8c11f47f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/7a7a08c2-8adb-4be7-8e3a-97edf339fcf0_removebg.jpg?w=600'], 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/24 32K', 'remarks': 'VOSA STATES, 20K, 24K, 32K, 43K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8d47490f-4e61-4992-8a9b-56213c8c9118.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3233a761-98b5-5028-a7b3-4e0a47903259 with identifier: 117123365
2025-11-27 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3233a761-98b5-5028-a7b3-4e0a47903259 with scrape type 2
2025-11-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3233a761-98b5-5028-a7b3-4e0a47903259 with scrape type 2
2025-11-27 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3233a761-98b5-5028-a7b3-4e0a47903259, identifier: 117123365
2025-11-27 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116759189, 'registration': 'EO25NNC', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 3719, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2729, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-03-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO25NNC/2025-10-30/image/0980b010-5490-4bc8-8ac1-d8cf281279df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/52bcb8b8-e71f-43e4-b0d4-9508c1491be8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e34caf49-45e8-4428-ac9f-24de0e6aa9f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/39220d34-7c72-4131-bd39-45dcfdfd09ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/9fb0a8ad-087b-4a9f-96e4-d4420f8e9ae8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e4b501c9-2d88-441f-ae6c-27829aa65758_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/df92f791-8cf4-4dbe-afe0-55001047399b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/3d8026d6-bd33-4536-a5f9-2f8428a24859_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/eb531688-0cab-404a-a18c-a21e706e3ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/f2865e8e-2e55-46a2-98ba-86cdfb9d5dd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2e049e12-ed42-4814-bf8b-cebb1f5fe668.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116759189, 'registration': 'EO25NNC', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 3719, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2729, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-03-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO25NNC/2025-10-30/image/0980b010-5490-4bc8-8ac1-d8cf281279df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/52bcb8b8-e71f-43e4-b0d4-9508c1491be8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e34caf49-45e8-4428-ac9f-24de0e6aa9f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/39220d34-7c72-4131-bd39-45dcfdfd09ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/9fb0a8ad-087b-4a9f-96e4-d4420f8e9ae8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/e4b501c9-2d88-441f-ae6c-27829aa65758_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/df92f791-8cf4-4dbe-afe0-55001047399b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/3d8026d6-bd33-4536-a5f9-2f8428a24859_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/eb531688-0cab-404a-a18c-a21e706e3ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO25NNC/2025-10-30/image/f2865e8e-2e55-46a2-98ba-86cdfb9d5dd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2e049e12-ed42-4814-bf8b-cebb1f5fe668.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189
2025-11-27 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6e0595-5fac-5e70-ad80-f82d5682930b with scrape type 2
2025-11-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6e0595-5fac-5e70-ad80-f82d5682930b with scrape type 2
2025-11-27 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bc6e0595-5fac-5e70-ad80-f82d5682930b, identifier: 116759189
2025-11-27 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/cf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 116180277
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116180277%27 HTTP/1.1" 200 None
2025-11-27 19:00:57 [astonbarclay.gb] INFO: Scrape type for 116180277: 0
2025-11-27 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 117087842
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117087842%27 HTTP/1.1" 200 None
2025-11-27 19:00:57 [astonbarclay.gb] INFO: Scrape type for 117087842: 2
2025-11-27 19:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3233a761-98b5-5028-a7b3-4e0a47903259 with identifier: 117123365
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2025-11-27 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3233a761-98b5-5028-a7b3-4e0a47903259 with identifier: 117123365
2025-11-27 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3233a761-98b5-5028-a7b3-4e0a47903259 with identifier: 117123365 to the API
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117123365?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3233a761-98b5-5028-a7b3-4e0a47903259',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OE19RKZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117123365',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '5008 ESTATE',
 'odometer': 43980,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-29',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 5008 ESTATE 1.6 PureTech 180 Allure 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.6 PureTech 180 Allure 5dr EAT8',
 'vin': None,
 'year': 2019}
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123365%27 HTTP/1.1" 200 None
2025-11-27 19:00:57 [astonbarclay.gb] INFO: Saving data for 117123365: {'auction_closing_time': 1764583200.0, 'created_time': 1762974233.157676, 'last_price_update_time': 1764270057.685693}
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117123365') HTTP/1.1" 204 0
2025-11-27 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189
2025-11-27 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189
2025-11-27 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bc6e0595-5fac-5e70-ad80-f82d5682930b with identifier: 116759189 to the API
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116759189?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bc6e0595-5fac-5e70-ad80-f82d5682930b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO25NNC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116759189',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 3719,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-03',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2025}
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116759189%27 HTTP/1.1" 200 None
2025-11-27 19:00:58 [astonbarclay.gb] INFO: Saving data for 116759189: {'auction_closing_time': 1764583200.0, 'created_time': 1763579073.707863, 'last_price_update_time': 1764270058.063655}
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116759189') HTTP/1.1" 204 0
2025-11-27 19:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 117485765
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117485765%27 HTTP/1.1" 200 None
2025-11-27 19:00:58 [astonbarclay.gb] INFO: Scrape type for 117485765: 0
2025-11-27 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 116660642
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116660642%27 HTTP/1.1" 200 None
2025-11-27 19:00:58 [astonbarclay.gb] INFO: Scrape type for 116660642: 2
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec32750>
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea85290>
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_10.jpg HTTP/1.1" 201 0
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Faf593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea1f790>
2025-11-27 19:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea9afd0>
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN71WCD%252F2025-11-25%252Fimage%252F4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2fb09a9-029b-5eab-ae02-9631ac546b3d
2025-11-27 19:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2fb09a9-029b-5eab-ae02-9631ac546b3d, skipping ID generation
2025-11-27 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2fb09a9-029b-5eab-ae02-9631ac546b3d with scrape type 1
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2fb09a9-029b-5eab-ae02-9631ac546b3d from tracking dictionaries
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2fb09a9-029b-5eab-ae02-9631ac546b3d sending to next pipeline
2025-11-27 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b2fb09a9-029b-5eab-ae02-9631ac546b3d, identifier: 117411712
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eacff50>
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg?w=600 saved to cache
2025-11-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea1e110>
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYM23WUT%252F2025-11-26%252Fimage%252Fba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 381ae8de-d0f2-5e40-9f7a-83282541e764
2025-11-27 19:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 381ae8de-d0f2-5e40-9f7a-83282541e764, skipping ID generation
2025-11-27 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 381ae8de-d0f2-5e40-9f7a-83282541e764 with scrape type 1
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 381ae8de-d0f2-5e40-9f7a-83282541e764 from tracking dictionaries
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 381ae8de-d0f2-5e40-9f7a-83282541e764 sending to next pipeline
2025-11-27 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 381ae8de-d0f2-5e40-9f7a-83282541e764, identifier: 116763299
2025-11-27 19:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab9150>
2025-11-27 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117209230, 'registration': 'VK72WGU', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 31987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2731, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-18', 'fuel': 'Petrol', 'motExpiry': '2026-08-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK72WGU/2025-11-13/image/549562fd-c967-4c10-88a8-ab3a3450a1ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/687987f7-a3fc-4399-b6aa-26533929cdd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/11ec8cc6-d072-4fa1-a55b-d150612a0d7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/60943081-296c-47e1-9173-435c34e590b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/c2497159-dc3e-4dd3-acd9-631ca4111e9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/3b9885d0-e422-4943-8894-014798283b8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/dcfa2d44-8d83-4267-b917-f6676d164602_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/0bb104ab-9d6b-47ce-b1e2-21958af0f7fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/e9fd5907-a8e5-4dd1-8394-156b69580e62_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 09/23 12K - 05/24 22K', 'remarks': 'VOSA STATES 30K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc26c0e9-18ab-44e2-b77a-3c0574f8562b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117209230, 'registration': 'VK72WGU', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 31987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2731, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-18', 'fuel': 'Petrol', 'motExpiry': '2026-08-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK72WGU/2025-11-13/image/549562fd-c967-4c10-88a8-ab3a3450a1ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/687987f7-a3fc-4399-b6aa-26533929cdd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/11ec8cc6-d072-4fa1-a55b-d150612a0d7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/60943081-296c-47e1-9173-435c34e590b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/c2497159-dc3e-4dd3-acd9-631ca4111e9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/3b9885d0-e422-4943-8894-014798283b8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/dcfa2d44-8d83-4267-b917-f6676d164602_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/0bb104ab-9d6b-47ce-b1e2-21958af0f7fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK72WGU/2025-11-13/image/e9fd5907-a8e5-4dd1-8394-156b69580e62_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 09/23 12K - 05/24 22K', 'remarks': 'VOSA STATES 30K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc26c0e9-18ab-44e2-b77a-3c0574f8562b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c950a3c-cb4e-52af-ac74-54671fb1771c with identifier: 117209230
2025-11-27 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c950a3c-cb4e-52af-ac74-54671fb1771c with scrape type 2
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c950a3c-cb4e-52af-ac74-54671fb1771c with scrape type 2
2025-11-27 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c950a3c-cb4e-52af-ac74-54671fb1771c, identifier: 117209230
2025-11-27 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117083405, 'registration': 'LO22GOC', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI Style 5dr DSG', 'mileage': 18235, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2720, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-22', 'fuel': 'Petrol', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO22GOC/2025-11-12/image/ae8a222c-27e5-4ee2-bb22-c687d1466766_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/4aefd8e8-b1eb-4e51-bc88-07008793b3ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/2dcc1a04-e5a4-44ec-aae0-4d5fe919da5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/854bead7-9844-4fd6-9994-4a58798c2cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/eae8731d-4af1-4689-9a15-0c0cbac14600_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/7712fed6-5819-4220-b78c-96ed05335283_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/f6c149a6-cadc-4561-a2a9-881039d37e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/a85a8300-2da9-4495-9ffa-bbe3ba5235b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/65d5ca7d-b46e-4e9d-a43f-c702e8382de8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/24 7K', 'remarks': 'VOSA STATES, 15K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd8d34c7-4840-4bb4-8c10-b26c9c439d1c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117083405, 'registration': 'LO22GOC', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI Style 5dr DSG', 'mileage': 18235, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2720, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-22', 'fuel': 'Petrol', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO22GOC/2025-11-12/image/ae8a222c-27e5-4ee2-bb22-c687d1466766_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/4aefd8e8-b1eb-4e51-bc88-07008793b3ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/2dcc1a04-e5a4-44ec-aae0-4d5fe919da5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/854bead7-9844-4fd6-9994-4a58798c2cf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/eae8731d-4af1-4689-9a15-0c0cbac14600_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/7712fed6-5819-4220-b78c-96ed05335283_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/f6c149a6-cadc-4561-a2a9-881039d37e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/a85a8300-2da9-4495-9ffa-bbe3ba5235b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22GOC/2025-11-12/image/65d5ca7d-b46e-4e9d-a43f-c702e8382de8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/24 7K', 'remarks': 'VOSA STATES, 15K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd8d34c7-4840-4bb4-8c10-b26c9c439d1c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f9f704e-8373-5add-8fb5-7fa40ead4a94 with identifier: 117083405
2025-11-27 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f9f704e-8373-5add-8fb5-7fa40ead4a94 with scrape type 2
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f9f704e-8373-5add-8fb5-7fa40ead4a94 with scrape type 2
2025-11-27 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6f9f704e-8373-5add-8fb5-7fa40ead4a94, identifier: 117083405
2025-11-27 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117296291, 'registration': 'EA25RNX', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 2877, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2730, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA25RNX/2025-11-19/image/11d079c2-7696-4f5e-b9ad-99c877f7730c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/4d7a7482-8cc5-4934-aff7-1bd69e1ce751_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/91aa724b-c91d-4d9d-875c-cefba3d70185_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/ecf83519-fee9-4bbb-baa0-f25cb909af69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/b9c5c354-2e2d-4c27-a5fe-902c486f91d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/eeb11615-5c76-4ce7-a963-c6f60d4930db_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/fa8af451-f79f-4dd1-b9a1-10a9604d9918_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/8d6c25fb-d5e1-49dd-9ad3-d685166e7205_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/54a7600c-24fa-44d9-a93e-3ea6685ccb40.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117296291, 'registration': 'EA25RNX', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 2877, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2730, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA25RNX/2025-11-19/image/11d079c2-7696-4f5e-b9ad-99c877f7730c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/4d7a7482-8cc5-4934-aff7-1bd69e1ce751_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/91aa724b-c91d-4d9d-875c-cefba3d70185_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/ecf83519-fee9-4bbb-baa0-f25cb909af69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/b9c5c354-2e2d-4c27-a5fe-902c486f91d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/eeb11615-5c76-4ce7-a963-c6f60d4930db_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/fa8af451-f79f-4dd1-b9a1-10a9604d9918_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA25RNX/2025-11-19/image/8d6c25fb-d5e1-49dd-9ad3-d685166e7205_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/54a7600c-24fa-44d9-a93e-3ea6685ccb40.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6488bf5-7787-559b-870a-fdce5dea8eef with identifier: 117296291
2025-11-27 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6488bf5-7787-559b-870a-fdce5dea8eef with scrape type 2
2025-11-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6488bf5-7787-559b-870a-fdce5dea8eef with scrape type 2
2025-11-27 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6488bf5-7787-559b-870a-fdce5dea8eef, identifier: 117296291
2025-11-27 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b2fb09a9-029b-5eab-ae02-9631ac546b3d with identifier: 117411712
2025-11-27 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b2fb09a9-029b-5eab-ae02-9631ac546b3d with identifier: 117411712
2025-11-27 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 37769, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh sport 5dr auto [c+s]', 'license_plate': 'vn71wcd', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37085}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48381}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55020}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 60783} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vn71wcd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 37769,
     'odometer_in_km': 60783,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31812,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30472,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34750,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33181,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37085,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62221,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49730,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48381,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55020,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-10',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh sport 5dr auto [c+s]',
     'vin': None,
     'year': 2021}
2025-11-27 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b2fb09a9-029b-5eab-ae02-9631ac546b3d spider: astonbarclay.gb
2025-11-27 19:01:00 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b2fb09a9-029b-5eab-ae02-9631ac546b3d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 37769, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh sport 5dr auto [c+s]', 'license_plate': 'vn71wcd', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30472}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37085}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48381}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55020}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 60783} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vn71wcd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 37769,
     'odometer_in_km': 60783,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31812,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30472,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34750,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33181,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37085,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62221,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49730,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48381,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55020,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-10',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh sport 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh sport 5dr auto [c+s]',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'b2fb09a9-029b-5eab-ae02-9631ac546b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VN71WCD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117411712',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 37769,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31812,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/4c92ba00-68ae-4194-b37a-b433f260ba9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30472,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/b26aa5d5-b284-445c-b37c-00b293acc564_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34750,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/a3739dbe-132a-4f95-a693-88e579aa2f77_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33181,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/36456271-2c81-4a91-8fa9-3cc5c271451a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37085,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e10e2d2d-1619-438d-95aa-49280dd8cec5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62221,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/aa0dc198-1cc0-48ca-a913-d592175be946_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49730,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/e3df3704-b058-4572-a9dd-6f517c58e0bc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48381,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/7140206e-5a7b-4405-a00a-637bf9a46116_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2fb09a9-029b-5eab-ae02-9631ac546b3d/b2fb09a9-029b-5eab-ae02-9631ac546b3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55020,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN71WCD/2025-11-25/image/fa717d85-bcf0-47cc-b073-704100cd96f7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh Sport 5dr Auto [C+S]',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh Sport 5dr Auto [C+S]',
 'vin': None,
 'year': 2021}
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411712%27 HTTP/1.1" 200 None
2025-11-27 19:01:00 [astonbarclay.gb] INFO: Saving data for 117411712: {'created_time': 1764270060.927212, 'last_price_update_time': 1764270060.927225, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117411712') HTTP/1.1" 204 0
2025-11-27 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 381ae8de-d0f2-5e40-9f7a-83282541e764 with identifier: 116763299
2025-11-27 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 381ae8de-d0f2-5e40-9f7a-83282541e764 with identifier: 116763299
2025-11-27 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 11, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mini hatchback electric 135kw cooper s level 3 33kwh 3dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'hatchback electric', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 7084, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116763299', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '135kw cooper s level 3 33kwh 3dr auto', 'license_plate': 'ym23wut', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 3, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '381ae8de-d0f2-5e40-9f7a-83282541e764', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37392}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38470}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44700}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56516}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62793}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48908}], 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'mini hatchback electric', 'sanitized_make': 'mini', 'odometer_in_km': 11400} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '381ae8de-d0f2-5e40-9f7a-83282541e764',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ym23wut',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116763299',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mini',
     'make_model': 'mini hatchback electric',
     'model': 'hatchback electric',
     'odometer': 7084,
     'odometer_in_km': 11400,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 11,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37392,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38470,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31635,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34425,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50421,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50147,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44700,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56516,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49129,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62793,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48908,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-07-20',
     'sanitized_make': 'mini',
     'seller_name': 'zenith',
     'title': 'mini hatchback electric 135kw cooper s level 3 33kwh 3dr '
              'auto',
     'transmission': 'automatic',
     'trim': '135kw cooper s level 3 33kwh 3dr auto',
     'vin': None,
     'year': 2023}
2025-11-27 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 381ae8de-d0f2-5e40-9f7a-83282541e764 spider: astonbarclay.gb
2025-11-27 19:01:01 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 381ae8de-d0f2-5e40-9f7a-83282541e764 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 11, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mini hatchback electric 135kw cooper s level 3 33kwh 3dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'hatchback electric', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 7084, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-20', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116763299', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '135kw cooper s level 3 33kwh 3dr auto', 'license_plate': 'ym23wut', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 3, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '381ae8de-d0f2-5e40-9f7a-83282541e764', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37392}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38470}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44700}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56516}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62793}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_10.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48908}], 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'mini hatchback electric', 'sanitized_make': 'mini', 'odometer_in_km': 11400} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '381ae8de-d0f2-5e40-9f7a-83282541e764',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ym23wut',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116763299',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mini',
     'make_model': 'mini hatchback electric',
     'model': 'hatchback electric',
     'odometer': 7084,
     'odometer_in_km': 11400,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 11,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37392,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38470,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31635,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34425,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50421,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50147,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44700,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56516,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49129,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62793,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48908,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-07-20',
     'sanitized_make': 'mini',
     'seller_name': 'zenith',
     'title': 'mini hatchback electric 135kw cooper s level 3 33kwh 3dr '
              'auto',
     'transmission': 'automatic',
     'trim': '135kw cooper s level 3 33kwh 3dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '381ae8de-d0f2-5e40-9f7a-83282541e764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YM23WUT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116763299',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MINI',
 'model': 'HATCHBACK ELECTRIC',
 'odometer': 7084,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37392,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/ba4504ef-1276-4779-a6cc-223af4cc2bce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38470,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/f1249bf4-3cad-4b1f-8b6c-8854ef7b4e7f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31635,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/8f6b5de5-f7da-4392-a13b-ec6c9b9513a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34425,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/792380f3-c98b-4007-a241-e80670db4f7c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50421,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/04b308d5-4d46-4b85-81ab-ca0d65b340bc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50147,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/735391f8-91ec-4716-8b0e-0c17f08cd8f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44700,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/5fdc768b-09cd-4b4f-8e10-c590751b88fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56516,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/b22a3b80-623b-46f3-9070-6020508855b8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49129,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/438431e5-380f-40a8-9c74-5660c06e336c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62793,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/28eee46d-b22a-4ef7-995d-2fc71443eeff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381ae8de-d0f2-5e40-9f7a-83282541e764/381ae8de-d0f2-5e40-9f7a-83282541e764_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48908,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YM23WUT/2025-11-26/image/af593f95-bdcf-401a-8f4e-116bfe73e319_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seller_name': 'Zenith',
 'title': 'MINI HATCHBACK ELECTRIC 135kW Cooper S Level 3 33kWh 3dr Auto',
 'transmission': 'automatic',
 'trim': '135kW Cooper S Level 3 33kWh 3dr Auto',
 'vin': None,
 'year': 2023}
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116763299%27 HTTP/1.1" 200 None
2025-11-27 19:01:01 [astonbarclay.gb] INFO: Saving data for 116763299: {'created_time': 1764270061.27114, 'last_price_update_time': 1764270061.271151, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116763299') HTTP/1.1" 204 0
2025-11-27 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c950a3c-cb4e-52af-ac74-54671fb1771c with identifier: 117209230
2025-11-27 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c950a3c-cb4e-52af-ac74-54671fb1771c with identifier: 117209230
2025-11-27 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5c950a3c-cb4e-52af-ac74-54671fb1771c with identifier: 117209230 to the API
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117209230?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5c950a3c-cb4e-52af-ac74-54671fb1771c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VK72WGU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209230',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 31987,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209230%27 HTTP/1.1" 200 None
2025-11-27 19:01:01 [astonbarclay.gb] INFO: Saving data for 117209230: {'auction_closing_time': 1764583200.0, 'created_time': 1763060595.663896, 'last_price_update_time': 1764270061.564593}
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117209230') HTTP/1.1" 204 0
2025-11-27 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6f9f704e-8373-5add-8fb5-7fa40ead4a94 with identifier: 117083405
2025-11-27 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6f9f704e-8373-5add-8fb5-7fa40ead4a94 with identifier: 117083405
2025-11-27 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6f9f704e-8373-5add-8fb5-7fa40ead4a94 with identifier: 117083405 to the API
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117083405?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6f9f704e-8373-5add-8fb5-7fa40ead4a94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO22GOC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117083405',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 18235,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-22',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 1.5 TSI Style 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI Style 5dr DSG',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117083405%27 HTTP/1.1" 200 None
2025-11-27 19:01:01 [astonbarclay.gb] INFO: Saving data for 117083405: {'auction_closing_time': 1764583200.0, 'created_time': 1763579026.009434, 'last_price_update_time': 1764270061.847688}
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117083405') HTTP/1.1" 204 0
2025-11-27 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6488bf5-7787-559b-870a-fdce5dea8eef with identifier: 117296291
2025-11-27 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6488bf5-7787-559b-870a-fdce5dea8eef with identifier: 117296291
2025-11-27 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6488bf5-7787-559b-870a-fdce5dea8eef with identifier: 117296291 to the API
2025-11-27 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a6488bf5-7787-559b-870a-fdce5dea8eef%27 HTTP/1.1" 200 None
2025-11-27 19:01:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a6488bf5-7787-559b-870a-fdce5dea8eef: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:01 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117296291?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a6488bf5-7787-559b-870a-fdce5dea8eef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA25RNX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117296291',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 2877,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-30',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 5dr',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117296291%27 HTTP/1.1" 200 None
2025-11-27 19:01:02 [astonbarclay.gb] INFO: Saving data for 117296291: {'auction_closing_time': 1764583200.0, 'created_time': 1763492833.94422, 'last_price_update_time': 1764270062.123997}
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117296291') HTTP/1.1" 204 0
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea05710>
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecad310>
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Fcf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/cf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/b607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/af7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 116888300
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116888300%27 HTTP/1.1" 200 None
2025-11-27 19:01:02 [astonbarclay.gb] INFO: Scrape type for 116888300: 2
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024793?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116744389?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116515726?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe093d0>
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252Fa5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb9b990>
2025-11-27 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117131580
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131580%27 HTTP/1.1" 200 None
2025-11-27 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117131580: 2
2025-11-27 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117185317
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185317%27 HTTP/1.1" 200 None
2025-11-27 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117185317: 2
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd5410>
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe13c50>
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Fb607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/b607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecb5a50>
2025-11-27 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252Faf7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/af7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe109d0>
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd4210>
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecb6410>
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024793, 'registration': 'LC72AXK', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 110 SE 5dr DSG', 'mileage': 7854, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2715, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LC72AXK/2025-11-13/image/ae21db7b-e166-4e53-81f2-67898815e593_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/93f22c76-d192-4679-a7c0-2152ca6171f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/2afe7fad-7ff1-4928-9725-eb45289050db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/a21cb111-15f8-4240-ace7-799102d84d7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/82a9d811-e93b-486b-92fc-a847b86464dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/be4cd6ab-325c-488b-a800-dd118c4bec20_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/43d4e544-538a-4f98-9fd0-ebec4e027aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/f3901d85-0a3d-4514-b575-3d1a18195591_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/9e8c31cc-e5a2-48da-99b6-6d2808a1ca0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/1e98b09e-bb1f-4537-aff0-3fd864130bb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/df1e32bb-bb09-44aa-bb81-76465d99ddd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/bdbca73e-5511-42cc-a456-255f2ed1a4f4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/25 10K', 'remarks': 'MILEAGE DISCREPANCY ON SERVICE PRINT @ 10K & - SAYS MOT @ 17K -VOSA STATES, 7K -ADAPTION REMOVED HAND CONTROLS', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e64836e2-2efa-4160-a5ee-868390b48666.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024793, 'registration': 'LC72AXK', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 110 SE 5dr DSG', 'mileage': 7854, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2715, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LC72AXK/2025-11-13/image/ae21db7b-e166-4e53-81f2-67898815e593_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/93f22c76-d192-4679-a7c0-2152ca6171f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/2afe7fad-7ff1-4928-9725-eb45289050db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/a21cb111-15f8-4240-ace7-799102d84d7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/82a9d811-e93b-486b-92fc-a847b86464dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/be4cd6ab-325c-488b-a800-dd118c4bec20_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/43d4e544-538a-4f98-9fd0-ebec4e027aef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/f3901d85-0a3d-4514-b575-3d1a18195591_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/9e8c31cc-e5a2-48da-99b6-6d2808a1ca0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/1e98b09e-bb1f-4537-aff0-3fd864130bb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/df1e32bb-bb09-44aa-bb81-76465d99ddd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC72AXK/2025-11-13/image/bdbca73e-5511-42cc-a456-255f2ed1a4f4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/25 10K', 'remarks': 'MILEAGE DISCREPANCY ON SERVICE PRINT @ 10K & - SAYS MOT @ 17K -VOSA STATES, 7K -ADAPTION REMOVED HAND CONTROLS', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e64836e2-2efa-4160-a5ee-868390b48666.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748faffb-df8e-58fe-8dfe-b9c43ec74dda with identifier: 117024793
2025-11-27 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748faffb-df8e-58fe-8dfe-b9c43ec74dda with scrape type 2
2025-11-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 748faffb-df8e-58fe-8dfe-b9c43ec74dda with scrape type 2
2025-11-27 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 748faffb-df8e-58fe-8dfe-b9c43ec74dda, identifier: 117024793
2025-11-27 19:01:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116744389, 'registration': 'LV24ELX', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '160kW Ultimate 65kWh 5dr Auto', 'mileage': 46375, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2734, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-08', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV24ELX/2025-11-06/image/44bbbd27-1668-4e23-b9d9-bd15612712d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/4cf3f98e-663c-4198-a89b-41dbbbb43214_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/fae3deef-c147-4c5b-89c7-8a20deda7238_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/720d6f36-c28c-44c2-9439-30374f335a5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/b2a9accf-797f-467e-b221-a74ee923da52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/729836e4-6c9b-4024-aa0f-7c3828e4eb48_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/e3406afe-5be7-4a65-920c-a702b1d36b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/b870af83-adb1-4abc-9475-0b1348ec1196_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/60fbe657-99a0-4d66-bab2-43dd64186c03_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/9b239cf8-3cae-4c5b-a144-d28bdbfdfbfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/6021d18d-3d2c-4717-ba51-2c587b49aae4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 22K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8d1f39f8-441b-4063-98c6-16a3b6d6d9e1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116744389, 'registration': 'LV24ELX', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '160kW Ultimate 65kWh 5dr Auto', 'mileage': 46375, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2734, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-08', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV24ELX/2025-11-06/image/44bbbd27-1668-4e23-b9d9-bd15612712d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/4cf3f98e-663c-4198-a89b-41dbbbb43214_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/fae3deef-c147-4c5b-89c7-8a20deda7238_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/720d6f36-c28c-44c2-9439-30374f335a5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/b2a9accf-797f-467e-b221-a74ee923da52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/729836e4-6c9b-4024-aa0f-7c3828e4eb48_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/e3406afe-5be7-4a65-920c-a702b1d36b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/b870af83-adb1-4abc-9475-0b1348ec1196_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/60fbe657-99a0-4d66-bab2-43dd64186c03_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/9b239cf8-3cae-4c5b-a144-d28bdbfdfbfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24ELX/2025-11-06/image/6021d18d-3d2c-4717-ba51-2c587b49aae4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 22K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8d1f39f8-441b-4063-98c6-16a3b6d6d9e1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8da7e95f-a786-5601-bb05-7986b9265926 with identifier: 116744389
2025-11-27 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8da7e95f-a786-5601-bb05-7986b9265926 with scrape type 2
2025-11-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8da7e95f-a786-5601-bb05-7986b9265926 with scrape type 2
2025-11-27 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8da7e95f-a786-5601-bb05-7986b9265926, identifier: 116744389
2025-11-27 19:01:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116515726, 'registration': 'LC22XEA', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech GT Premium 5dr EAT8', 'mileage': 25375, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2732, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LC22XEA/2025-10-21/image/e9b0bbf0-4fd8-47d1-b727-1d817b927a41_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/00db1682-ae38-4935-b079-e0d6a3eaa10b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/7442f21d-e785-4a27-a2ef-ff2199650737_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/c3083653-94e3-476a-ba22-c739926ebbcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/207e4aee-9872-4428-b0dd-05ae2f76bfaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/c78e6750-973a-469d-82ca-5cee5c6d8e96_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/5657204b-71c6-4fec-b2b2-d8f2126ba7b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/b85a6ae0-82a0-4ead-ad8c-9b12ce03a5c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/b8421a5e-e860-4278-bf66-46fc957014b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/7fe190b6-54d5-45d8-aa04-ab030d582857_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/23 7K - 12/24 21K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/946afa72-5f33-4099-a823-142e686dd7c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116515726, 'registration': 'LC22XEA', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech GT Premium 5dr EAT8', 'mileage': 25375, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2732, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LC22XEA/2025-10-21/image/e9b0bbf0-4fd8-47d1-b727-1d817b927a41_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/00db1682-ae38-4935-b079-e0d6a3eaa10b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/7442f21d-e785-4a27-a2ef-ff2199650737_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/c3083653-94e3-476a-ba22-c739926ebbcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/207e4aee-9872-4428-b0dd-05ae2f76bfaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/c78e6750-973a-469d-82ca-5cee5c6d8e96_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/5657204b-71c6-4fec-b2b2-d8f2126ba7b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/b85a6ae0-82a0-4ead-ad8c-9b12ce03a5c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/b8421a5e-e860-4278-bf66-46fc957014b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC22XEA/2025-10-21/image/7fe190b6-54d5-45d8-aa04-ab030d582857_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/23 7K - 12/24 21K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/946afa72-5f33-4099-a823-142e686dd7c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391509e7-8fc5-595f-b53d-fa9cff59fce5 with identifier: 116515726
2025-11-27 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 391509e7-8fc5-595f-b53d-fa9cff59fce5 with scrape type 2
2025-11-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 391509e7-8fc5-595f-b53d-fa9cff59fce5 with scrape type 2
2025-11-27 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 391509e7-8fc5-595f-b53d-fa9cff59fce5, identifier: 116515726
2025-11-27 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 748faffb-df8e-58fe-8dfe-b9c43ec74dda with identifier: 117024793
2025-11-27 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 748faffb-df8e-58fe-8dfe-b9c43ec74dda with identifier: 117024793
2025-11-27 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 748faffb-df8e-58fe-8dfe-b9c43ec74dda with identifier: 117024793 to the API
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27748faffb-df8e-58fe-8dfe-b9c43ec74dda%27 HTTP/1.1" 200 None
2025-11-27 19:01:05 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 748faffb-df8e-58fe-8dfe-b9c43ec74dda: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:05 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024793?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '748faffb-df8e-58fe-8dfe-b9c43ec74dda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LC72AXK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024793',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS ESTATE',
 'odometer': 7854,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-29',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN T-CROSS ESTATE 1.0 TSI 110 SE 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 110 SE 5dr DSG',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024793%27 HTTP/1.1" 200 None
2025-11-27 19:01:05 [astonbarclay.gb] INFO: Saving data for 117024793: {'auction_closing_time': 1764583200.0, 'created_time': 1762455792.241612, 'last_price_update_time': 1764270065.645576}
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024793') HTTP/1.1" 204 0
2025-11-27 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8da7e95f-a786-5601-bb05-7986b9265926 with identifier: 116744389
2025-11-27 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8da7e95f-a786-5601-bb05-7986b9265926 with identifier: 116744389
2025-11-27 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 160kw ultimate 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 46375, 'odometer_reading_unit': 'mi', 'registration_date': '2024-03-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116744389', 'expiration_date': '2025-12-01t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '160kw ultimate 65kwh 5dr auto', 'license_plate': 'lv24elx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8da7e95f-a786-5601-bb05-7986b9265926', 'current_year_diff': 1, 'age_in_months': 20, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 74633} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 20,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-01t10:00:00z',
     'fuel_type': 'electric',
     'id': '8da7e95f-a786-5601-bb05-7986b9265926',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lv24elx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116744389',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 46375,
     'odometer_in_km': 74633,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-03-08',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 160kw ultimate 65kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '160kw ultimate 65kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-11-27 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 8da7e95f-a786-5601-bb05-7986b9265926 spider: astonbarclay.gb
2025-11-27 19:01:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8da7e95f-a786-5601-bb05-7986b9265926 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 160kw ultimate 65kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 46375, 'odometer_reading_unit': 'mi', 'registration_date': '2024-03-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116744389', 'expiration_date': '2025-12-01t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '160kw ultimate 65kwh 5dr auto', 'license_plate': 'lv24elx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8da7e95f-a786-5601-bb05-7986b9265926', 'current_year_diff': 1, 'age_in_months': 20, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 74633} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 20,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-01t10:00:00z',
     'fuel_type': 'electric',
     'id': '8da7e95f-a786-5601-bb05-7986b9265926',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lv24elx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116744389',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 46375,
     'odometer_in_km': 74633,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-03-08',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 160kw ultimate 65kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '160kw ultimate 65kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '8da7e95f-a786-5601-bb05-7986b9265926',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV24ELX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116744389',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'KONA ELECTRIC HATCHBACK',
 'odometer': 46375,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-08',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI KONA ELECTRIC HATCHBACK 160kW Ultimate 65kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '160kW Ultimate 65kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116744389%27 HTTP/1.1" 200 None
2025-11-27 19:01:05 [astonbarclay.gb] INFO: Saving data for 116744389: {'auction_closing_time': 1764583200.0, 'created_time': 1763579066.99564, 'last_price_update_time': 1764270065.937284}
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116744389') HTTP/1.1" 204 0
2025-11-27 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 391509e7-8fc5-595f-b53d-fa9cff59fce5 with identifier: 116515726
2025-11-27 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 391509e7-8fc5-595f-b53d-fa9cff59fce5 with identifier: 116515726
2025-11-27 19:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 391509e7-8fc5-595f-b53d-fa9cff59fce5 with identifier: 116515726 to the API
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116515726?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '391509e7-8fc5-595f-b53d-fa9cff59fce5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LC22XEA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116515726',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '3008 ESTATE',
 'odometer': 25375,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-29',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 3008 ESTATE 1.2 PureTech GT Premium 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech GT Premium 5dr EAT8',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116515726%27 HTTP/1.1" 200 None
2025-11-27 19:01:06 [astonbarclay.gb] INFO: Saving data for 116515726: {'auction_closing_time': 1764583200.0, 'created_time': 1763579104.914392, 'last_price_update_time': 1764270066.231308}
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116515726') HTTP/1.1" 204 0
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/07f194e1-a943-44e3-9298-dca268526367_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:01:06 [scrapy.extensions.logstats] INFO: Crawled 64 pages (at 64 pages/min), scraped 37 items (at 37 items/min)
2025-11-27 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 116797614
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116797614%27 HTTP/1.1" 200 None
2025-11-27 19:01:06 [astonbarclay.gb] INFO: Scrape type for 116797614: 2
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116643961?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207910?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116798984?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117022929?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116744851?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 116025987
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116025987%27 HTTP/1.1" 200 None
2025-11-27 19:01:06 [astonbarclay.gb] INFO: Scrape type for 116025987: 2
2025-11-27 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb7b210>
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252Fd683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d404450>
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb1bf90>
2025-11-27 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252Feb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117183059
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183059%27 HTTP/1.1" 200 None
2025-11-27 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117183059: 2
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb165d0>
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecdc490>
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F07f194e1-a943-44e3-9298-dca268526367_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/07f194e1-a943-44e3-9298-dca268526367_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb18850>
2025-11-27 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Faa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116643961, 'registration': 'LX24UCV', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 25563, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2736, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LX24UCV/2025-11-25/image/61307134-4b62-48ff-beb2-bae27fb7b0c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/fd0b40e0-c087-4c19-9845-8462a0e544ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/ea1de0d2-afd2-49cd-862c-b5d1697adce7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/de71cfa1-5d16-4c0b-b67c-7e1967c1dc2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/8565dc0c-56a2-41a6-839d-ec93083b7526_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/f535dd16-7044-42e2-9c81-3e1274986ef0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/b6366db6-e3ca-44dc-a433-b66f10183ea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/65954ad4-141f-4088-8242-395842100083_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/aa6f7793-17af-4626-a8ac-6499a1f61f7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/d725bb07-c6a3-41da-9214-b1c9d4e2fbff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/cbdf989d-4958-4a9a-975e-e1ed6874951d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 15K - 09/25 23K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c489eca5-8c0e-46a3-9194-360b9612fa4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116643961, 'registration': 'LX24UCV', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 25563, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2736, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LX24UCV/2025-11-25/image/61307134-4b62-48ff-beb2-bae27fb7b0c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/fd0b40e0-c087-4c19-9845-8462a0e544ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/ea1de0d2-afd2-49cd-862c-b5d1697adce7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/de71cfa1-5d16-4c0b-b67c-7e1967c1dc2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/8565dc0c-56a2-41a6-839d-ec93083b7526_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/f535dd16-7044-42e2-9c81-3e1274986ef0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/b6366db6-e3ca-44dc-a433-b66f10183ea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/65954ad4-141f-4088-8242-395842100083_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/aa6f7793-17af-4626-a8ac-6499a1f61f7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/d725bb07-c6a3-41da-9214-b1c9d4e2fbff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX24UCV/2025-11-25/image/cbdf989d-4958-4a9a-975e-e1ed6874951d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 15K - 09/25 23K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c489eca5-8c0e-46a3-9194-360b9612fa4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961
2025-11-27 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348a8a38-e382-5b13-868e-184dbcfe0f74 with scrape type 2
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 348a8a38-e382-5b13-868e-184dbcfe0f74 with scrape type 2
2025-11-27 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 348a8a38-e382-5b13-868e-184dbcfe0f74, identifier: 116643961
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb19c50>
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9e773110>
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252Fc4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207910, 'registration': 'GL24YTO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo 136 Ultimate 5dr', 'mileage': 10046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2712, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-06-11', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GL24YTO/2025-11-13/image/cdee6bf5-976a-437f-8b59-3e9e818b87d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/117529e2-21a2-4aac-9c10-9a7f731f9134_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/20b4d2e6-5958-4b8a-9c3f-1547d62caed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/d9d33120-a009-4702-a963-48edd40172b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/cca9cf7e-d958-4f70-ba28-645bb23a470e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/b2ee61ec-69f4-47c4-8505-8f475f71aabc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/7ddecc35-b759-47b4-963f-e73f774b08b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/9242dc75-f693-4f88-8f3a-ba98bfdedc6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/5c8140eb-3a1d-4a9d-aeb9-ff2b1037a663_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/e277a9e7-e628-4a89-9ecf-d803e342a905_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/25 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd0492d4-a8e8-4572-89ed-b82de3eb2bed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207910, 'registration': 'GL24YTO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo 136 Ultimate 5dr', 'mileage': 10046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2712, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-06-11', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GL24YTO/2025-11-13/image/cdee6bf5-976a-437f-8b59-3e9e818b87d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/117529e2-21a2-4aac-9c10-9a7f731f9134_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/20b4d2e6-5958-4b8a-9c3f-1547d62caed6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/d9d33120-a009-4702-a963-48edd40172b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/cca9cf7e-d958-4f70-ba28-645bb23a470e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/b2ee61ec-69f4-47c4-8505-8f475f71aabc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/7ddecc35-b759-47b4-963f-e73f774b08b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/9242dc75-f693-4f88-8f3a-ba98bfdedc6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/5c8140eb-3a1d-4a9d-aeb9-ff2b1037a663_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL24YTO/2025-11-13/image/e277a9e7-e628-4a89-9ecf-d803e342a905_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 10/25 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd0492d4-a8e8-4572-89ed-b82de3eb2bed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93dadd11-7e4c-5b9b-8961-de07108b711e with identifier: 117207910
2025-11-27 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93dadd11-7e4c-5b9b-8961-de07108b711e with scrape type 2
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93dadd11-7e4c-5b9b-8961-de07108b711e with scrape type 2
2025-11-27 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 93dadd11-7e4c-5b9b-8961-de07108b711e, identifier: 117207910
2025-11-27 19:01:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116798984, 'registration': 'EN74UEU', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI R-Line 5dr DSG', 'mileage': 23763, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2737, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN74UEU/2025-11-06/image/b8aa37cc-25a3-4fd2-a85a-16790f021c80_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/357f79c5-84c7-4c79-804a-ef2f9be06a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/13d8fc2f-7d95-4ae3-917d-7643fd1fab12_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/45c9e719-8c2e-4570-a860-16080c837dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/d108d33d-5474-449d-b056-fd0cfa90013b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/95c0560b-e333-4d8a-bf76-68e5143d42f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/40d33196-6f7b-42cf-b74b-7871498770ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/4c4893c2-76f6-4a38-a1fa-a2b580120c4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/88168fc8-c0c9-425b-8463-73c290ab56c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/8192028b-6927-4a44-b107-c83065ae1c48_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5df9d02b-99da-47c2-908f-cbd84915a412.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116798984, 'registration': 'EN74UEU', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI R-Line 5dr DSG', 'mileage': 23763, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2737, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN74UEU/2025-11-06/image/b8aa37cc-25a3-4fd2-a85a-16790f021c80_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/357f79c5-84c7-4c79-804a-ef2f9be06a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/13d8fc2f-7d95-4ae3-917d-7643fd1fab12_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/45c9e719-8c2e-4570-a860-16080c837dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/d108d33d-5474-449d-b056-fd0cfa90013b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/95c0560b-e333-4d8a-bf76-68e5143d42f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/40d33196-6f7b-42cf-b74b-7871498770ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/4c4893c2-76f6-4a38-a1fa-a2b580120c4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/88168fc8-c0c9-425b-8463-73c290ab56c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74UEU/2025-11-06/image/8192028b-6927-4a44-b107-c83065ae1c48_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5df9d02b-99da-47c2-908f-cbd84915a412.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984
2025-11-27 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1345b979-45fe-5d85-95c7-051531f48040 with scrape type 2
2025-11-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1345b979-45fe-5d85-95c7-051531f48040 with scrape type 2
2025-11-27 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1345b979-45fe-5d85-95c7-051531f48040, identifier: 116798984
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117022929, 'registration': 'LL74UOY', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 200 AMG Line Executive 4dr Tip Auto', 'mileage': 2074, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2733, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LL74UOY/2025-11-10/image/c3a9749f-5950-46fe-8cf9-128a7dd5885f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/c5d82382-4728-4259-b9ae-6e3ec1b727aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/a057fa8b-c4c6-4e8d-831e-a76cb0538e52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/f8541e28-f691-4885-b340-c449ec34988e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/04e37d47-422c-417d-9ee8-6a6cebfbfee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/892dab96-71d9-4029-a9e6-c75a3e236c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/a6841bc3-d6b1-4e89-b663-58aa450b9b4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/25ec5f4a-3811-4dea-b124-d99157df408c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/460e1ebb-d622-45fb-9e66-6ea35e432883.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117022929, 'registration': 'LL74UOY', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 200 AMG Line Executive 4dr Tip Auto', 'mileage': 2074, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2733, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LL74UOY/2025-11-10/image/c3a9749f-5950-46fe-8cf9-128a7dd5885f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/c5d82382-4728-4259-b9ae-6e3ec1b727aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/a057fa8b-c4c6-4e8d-831e-a76cb0538e52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/f8541e28-f691-4885-b340-c449ec34988e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/04e37d47-422c-417d-9ee8-6a6cebfbfee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/892dab96-71d9-4029-a9e6-c75a3e236c7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/a6841bc3-d6b1-4e89-b663-58aa450b9b4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74UOY/2025-11-10/image/25ec5f4a-3811-4dea-b124-d99157df408c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/460e1ebb-d622-45fb-9e66-6ea35e432883.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ee4107-bd33-5be1-9132-2edf40fda745 with identifier: 117022929
2025-11-27 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ee4107-bd33-5be1-9132-2edf40fda745 with scrape type 2
2025-11-27 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38ee4107-bd33-5be1-9132-2edf40fda745 with scrape type 2
2025-11-27 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 38ee4107-bd33-5be1-9132-2edf40fda745, identifier: 117022929
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116744851, 'registration': 'LX73OOJ', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 52632, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2714, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-09-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/ab40614d-9fe5-4c84-aa13-f59be2b794d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/89e1fb04-277a-46b7-a5f7-910a0581c7b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/27978813-f0e4-453c-aec1-51cf0673034b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/0ef6ba87-9658-46f8-aa34-0247cc63a843_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/7e5aa0f0-3d8f-424c-a8d6-14032b20228c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/ca6f9a55-11f6-42d7-a93b-663e1032e07c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/5169d30c-3510-4030-82fd-3b96486dbaa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/424303fc-0970-473e-8ef8-46197bb6715d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/5ee4611d-6970-4dda-8f04-41756cec0713_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/dc0f54d5-cfcc-489f-a033-121163b2a606_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 26K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca3c9762-5949-4479-8953-c607082daa23.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116744851, 'registration': 'LX73OOJ', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 52632, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2714, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-09-21', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/ab40614d-9fe5-4c84-aa13-f59be2b794d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/89e1fb04-277a-46b7-a5f7-910a0581c7b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/27978813-f0e4-453c-aec1-51cf0673034b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/0ef6ba87-9658-46f8-aa34-0247cc63a843_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/7e5aa0f0-3d8f-424c-a8d6-14032b20228c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/ca6f9a55-11f6-42d7-a93b-663e1032e07c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/5169d30c-3510-4030-82fd-3b96486dbaa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/424303fc-0970-473e-8ef8-46197bb6715d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/5ee4611d-6970-4dda-8f04-41756cec0713_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73OOJ/2025-11-25/image/dc0f54d5-cfcc-489f-a033-121163b2a606_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 26K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ca3c9762-5949-4479-8953-c607082daa23.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb716ae4-9705-5101-9da5-82cd60fad325 with identifier: 116744851
2025-11-27 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb716ae4-9705-5101-9da5-82cd60fad325 with scrape type 2
2025-11-27 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb716ae4-9705-5101-9da5-82cd60fad325 with scrape type 2
2025-11-27 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb716ae4-9705-5101-9da5-82cd60fad325, identifier: 116744851
2025-11-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/b20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Found listing with ID: 116806926
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116806926%27 HTTP/1.1" 200 None
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Scrape type for 116806926: 2
2025-11-27 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961
2025-11-27 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961
2025-11-27 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 348a8a38-e382-5b13-868e-184dbcfe0f74 with identifier: 116643961 to the API
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116643961?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '348a8a38-e382-5b13-868e-184dbcfe0f74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX24UCV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116643961',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 25563,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-21',
 'seller_name': 'Motability Operations',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116643961%27 HTTP/1.1" 200 None
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Saving data for 116643961: {'auction_closing_time': 1764583200.0, 'created_time': 1763579002.774518, 'last_price_update_time': 1764270069.672367}
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116643961') HTTP/1.1" 204 0
2025-11-27 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 93dadd11-7e4c-5b9b-8961-de07108b711e with identifier: 117207910
2025-11-27 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 93dadd11-7e4c-5b9b-8961-de07108b711e with identifier: 117207910
2025-11-27 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 93dadd11-7e4c-5b9b-8961-de07108b711e with identifier: 117207910 to the API
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207910?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '93dadd11-7e4c-5b9b-8961-de07108b711e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GL24YTO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207910',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 10046,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-11',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.2 Turbo 136 Ultimate 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo 136 Ultimate 5dr',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207910%27 HTTP/1.1" 200 None
2025-11-27 19:01:09 [astonbarclay.gb] INFO: Saving data for 117207910: {'auction_closing_time': 1764583200.0, 'created_time': 1763060592.958737, 'last_price_update_time': 1764270069.967739}
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207910') HTTP/1.1" 204 0
2025-11-27 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984
2025-11-27 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984
2025-11-27 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1345b979-45fe-5d85-95c7-051531f48040 with identifier: 116798984 to the API
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116798984?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1345b979-45fe-5d85-95c7-051531f48040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN74UEU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116798984',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 23763,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-28',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 1.5 TSI R-Line 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI R-Line 5dr DSG',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116798984%27 HTTP/1.1" 200 None
2025-11-27 19:01:10 [astonbarclay.gb] INFO: Saving data for 116798984: {'auction_closing_time': 1764583200.0, 'created_time': 1763579017.782867, 'last_price_update_time': 1764270070.278114}
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116798984') HTTP/1.1" 204 0
2025-11-27 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 38ee4107-bd33-5be1-9132-2edf40fda745 with identifier: 117022929
2025-11-27 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 38ee4107-bd33-5be1-9132-2edf40fda745 with identifier: 117022929
2025-11-27 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 38ee4107-bd33-5be1-9132-2edf40fda745 with identifier: 117022929 to the API
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117022929?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '38ee4107-bd33-5be1-9132-2edf40fda745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL74UOY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117022929',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 2074,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-28',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 200 AMG Line Executive 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 200 AMG Line Executive 4dr Tip Auto',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022929%27 HTTP/1.1" 200 None
2025-11-27 19:01:10 [astonbarclay.gb] INFO: Saving data for 117022929: {'auction_closing_time': 1764583200.0, 'created_time': 1763579013.146173, 'last_price_update_time': 1764270070.59981}
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117022929') HTTP/1.1" 204 0
2025-11-27 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb716ae4-9705-5101-9da5-82cd60fad325 with identifier: 116744851
2025-11-27 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb716ae4-9705-5101-9da5-82cd60fad325 with identifier: 116744851
2025-11-27 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eb716ae4-9705-5101-9da5-82cd60fad325 with identifier: 116744851 to the API
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116744851?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'eb716ae4-9705-5101-9da5-82cd60fad325',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX73OOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116744851',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'ZS HATCHBACK',
 'odometer': 52632,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-21',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK ZS HATCHBACK 1.0T GDi Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0T GDi Exclusive 5dr DCT',
 'vin': None,
 'year': 2023}
2025-11-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116744851%27 HTTP/1.1" 200 None
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Saving data for 116744851: {'auction_closing_time': 1764583200.0, 'created_time': 1763579032.009313, 'last_price_update_time': 1764270071.007375}
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116744851') HTTP/1.1" 204 0
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaae1d0>
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd79050>
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 116752111
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116752111%27 HTTP/1.1" 200 None
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Scrape type for 116752111: 0
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 117024249
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024249%27 HTTP/1.1" 200 None
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Scrape type for 117024249: 0
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 116810166
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116810166%27 HTTP/1.1" 200 None
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Scrape type for 116810166: 2
2025-11-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117087842?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116660642?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116258586?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209835?view=catalogue)
2025-11-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 117053964
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117053964%27 HTTP/1.1" 200 None
2025-11-27 19:01:11 [astonbarclay.gb] INFO: Scrape type for 117053964: 2
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c353490>
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab3150>
2025-11-27 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fc3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecd0510>
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Fb20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/b20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab0bd0>
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb99950>
2025-11-27 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Faad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecd3e10>
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Found listing with ID: 116753648
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116753648%27 HTTP/1.1" 200 None
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Scrape type for 116753648: 2
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117087842, 'registration': 'LP74HZY', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'AUSTRAL ESTATE', 'derivative': 'E-Tech FHEV Iconic Esprit Alpine 5dr Auto', 'mileage': 8631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2739, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP74HZY/2025-11-12/image/09b11760-090a-4d00-8bb4-6bb65e12f41d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/2095e6ef-5ee1-4b3e-9dba-8450a14b626a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/041141ee-9b2b-4f29-a381-c9068f2631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6dbb0efe-cebd-497f-b2d9-45d177a037ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/399afc64-662c-46ed-9753-88b8465a0c28_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/fae99931-2e04-47b1-891e-172d7c7d1232_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6d85ba96-c5ef-49cf-817e-2c3018c8d828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/c2bb8997-7d80-4103-bce2-3dc9a7922f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/7129a889-a750-4c94-bb73-e7140d3e6c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/858f484c-8268-4734-b5fb-e10cee7222cb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3e95c39-32b2-480b-aa53-736a8cfd1304.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117087842, 'registration': 'LP74HZY', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'AUSTRAL ESTATE', 'derivative': 'E-Tech FHEV Iconic Esprit Alpine 5dr Auto', 'mileage': 8631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2739, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP74HZY/2025-11-12/image/09b11760-090a-4d00-8bb4-6bb65e12f41d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/2095e6ef-5ee1-4b3e-9dba-8450a14b626a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/041141ee-9b2b-4f29-a381-c9068f2631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6dbb0efe-cebd-497f-b2d9-45d177a037ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/399afc64-662c-46ed-9753-88b8465a0c28_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/fae99931-2e04-47b1-891e-172d7c7d1232_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/6d85ba96-c5ef-49cf-817e-2c3018c8d828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/c2bb8997-7d80-4103-bce2-3dc9a7922f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/7129a889-a750-4c94-bb73-e7140d3e6c4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP74HZY/2025-11-12/image/858f484c-8268-4734-b5fb-e10cee7222cb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3e95c39-32b2-480b-aa53-736a8cfd1304.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842
2025-11-27 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6cfee4e-4048-53f6-960e-9f5defdd1274 with scrape type 2
2025-11-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6cfee4e-4048-53f6-960e-9f5defdd1274 with scrape type 2
2025-11-27 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6cfee4e-4048-53f6-960e-9f5defdd1274, identifier: 117087842
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116660642, 'registration': 'EN74FAO', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI Black Edition 5dr S Tronic', 'mileage': 11437, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2741, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN74FAO/2025-10-24/image/4fd01696-9367-4b8c-9ffd-a36c1dc70703_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/447d3ef0-6f90-4b1a-a8bb-bdbf5169134a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/3e5395f1-3105-46fe-ac14-767ea3ea39b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/ac57caa1-a71a-408a-92e3-a65854382d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/da9ae03b-7b91-437a-a84d-278fa77a1e61_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/1a923dbb-7323-49e0-b2c9-79833af8a740_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/2d3c655e-f773-4a21-9466-881564f52802_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/f932f82f-423c-4820-b349-874ad36ee5cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/50265cd4-1036-47f7-be47-8904619a3b6f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/901391f5-bb58-4da7-a31d-9c56142bcf4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116660642, 'registration': 'EN74FAO', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI Black Edition 5dr S Tronic', 'mileage': 11437, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2741, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN74FAO/2025-10-24/image/4fd01696-9367-4b8c-9ffd-a36c1dc70703_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/447d3ef0-6f90-4b1a-a8bb-bdbf5169134a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/3e5395f1-3105-46fe-ac14-767ea3ea39b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/ac57caa1-a71a-408a-92e3-a65854382d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/da9ae03b-7b91-437a-a84d-278fa77a1e61_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/1a923dbb-7323-49e0-b2c9-79833af8a740_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/2d3c655e-f773-4a21-9466-881564f52802_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/f932f82f-423c-4820-b349-874ad36ee5cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74FAO/2025-10-24/image/50265cd4-1036-47f7-be47-8904619a3b6f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/901391f5-bb58-4da7-a31d-9c56142bcf4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da4bae0-5a8d-551f-90b3-a975ca247ce6 with identifier: 116660642
2025-11-27 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da4bae0-5a8d-551f-90b3-a975ca247ce6 with scrape type 2
2025-11-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da4bae0-5a8d-551f-90b3-a975ca247ce6 with scrape type 2
2025-11-27 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6da4bae0-5a8d-551f-90b3-a975ca247ce6, identifier: 116660642
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116258586, 'registration': 'LL74ZTP', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta 5dr', 'mileage': 10496, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2710, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/3e80401d-5b30-4e28-9e7d-622daf2a4837_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5d5347ee-42ef-4b7d-b649-a30e14413f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/58afb96b-3d2b-4e7c-99e1-6dbad4b19263_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5464fbfc-b7ef-4330-bf19-3e8b40335a1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/4168ebb9-cc54-48b9-8a7a-e010d57e1adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/77d912d0-5c17-47cb-b890-3575e0e519b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/36d03a01-acb7-4d6f-bec5-50e02eeb27ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/508ff39c-d447-441e-9a41-9d01c0cab952_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9ff96bc-b9b0-493d-95b6-476b34dec0ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116258586, 'registration': 'LL74ZTP', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta 5dr', 'mileage': 10496, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2710, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/3e80401d-5b30-4e28-9e7d-622daf2a4837_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5d5347ee-42ef-4b7d-b649-a30e14413f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/58afb96b-3d2b-4e7c-99e1-6dbad4b19263_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/5464fbfc-b7ef-4330-bf19-3e8b40335a1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/4168ebb9-cc54-48b9-8a7a-e010d57e1adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/77d912d0-5c17-47cb-b890-3575e0e519b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/36d03a01-acb7-4d6f-bec5-50e02eeb27ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/508ff39c-d447-441e-9a41-9d01c0cab952_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9ff96bc-b9b0-493d-95b6-476b34dec0ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586
2025-11-27 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbb4108-9119-5dcf-a063-7c20f6cad248 with scrape type 2
2025-11-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbb4108-9119-5dcf-a063-7c20f6cad248 with scrape type 2
2025-11-27 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0bbb4108-9119-5dcf-a063-7c20f6cad248, identifier: 116258586
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecd0c10>
2025-11-27 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252F4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea32f50>
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb46f50>
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBF73UZU%252F2025-11-27%252Fimage%252F6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf
2025-11-27 19:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf, skipping ID generation
2025-11-27 19:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with scrape type 1
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf from tracking dictionaries
2025-11-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf sending to next pipeline
2025-11-27 19:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf, identifier: 117209835
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdfdd50>
2025-11-27 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252F27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:01:15 [astonbarclay.gb] INFO: Found listing with ID: 116223544
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116223544%27 HTTP/1.1" 200 None
2025-11-27 19:01:15 [astonbarclay.gb] INFO: Scrape type for 116223544: 2
2025-11-27 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842
2025-11-27 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842
2025-11-27 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d6cfee4e-4048-53f6-960e-9f5defdd1274 with identifier: 117087842 to the API
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117087842?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'd6cfee4e-4048-53f6-960e-9f5defdd1274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP74HZY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117087842',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'AUSTRAL ESTATE',
 'odometer': 8631,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-17',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT AUSTRAL ESTATE E-Tech FHEV Iconic Esprit Alpine 5dr Auto',
 'transmission': 'automatic',
 'trim': 'E-Tech FHEV Iconic Esprit Alpine 5dr Auto',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117087842%27 HTTP/1.1" 200 None
2025-11-27 19:01:15 [astonbarclay.gb] INFO: Saving data for 117087842: {'auction_closing_time': 1764583200.0, 'created_time': 1763579108.273437, 'last_price_update_time': 1764270075.394961}
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117087842') HTTP/1.1" 204 0
2025-11-27 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6da4bae0-5a8d-551f-90b3-a975ca247ce6 with identifier: 116660642
2025-11-27 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6da4bae0-5a8d-551f-90b3-a975ca247ce6 with identifier: 116660642
2025-11-27 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6da4bae0-5a8d-551f-90b3-a975ca247ce6 with identifier: 116660642 to the API
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116660642?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6da4bae0-5a8d-551f-90b3-a975ca247ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN74FAO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116660642',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 11437,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-25',
 'seller_name': 'Motability Operations',
 'title': 'AUDI Q2 ESTATE 35 TFSI Black Edition 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI Black Edition 5dr S Tronic',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116660642%27 HTTP/1.1" 200 None
2025-11-27 19:01:15 [astonbarclay.gb] INFO: Saving data for 116660642: {'auction_closing_time': 1764583200.0, 'created_time': 1763579069.674828, 'last_price_update_time': 1764270075.818306}
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116660642') HTTP/1.1" 204 0
2025-11-27 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586
2025-11-27 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586
2025-11-27 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0bbb4108-9119-5dcf-a063-7c20f6cad248 with identifier: 116258586 to the API
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116258586?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0bbb4108-9119-5dcf-a063-7c20f6cad248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL74ZTP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116258586',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 10496,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-19',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH N-Connecta 5dr',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116258586%27 HTTP/1.1" 200 None
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Saving data for 116258586: {'auction_closing_time': 1764583200.0, 'created_time': 1761160143.995101, 'last_price_update_time': 1764270076.100521}
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116258586') HTTP/1.1" 204 0
2025-11-27 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835
2025-11-27 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835
2025-11-27 19:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf with identifier: 117209835 to the API
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BF73UZU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209835',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 28164,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34264,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/6d735ff2-09a3-418d-9c99-684f577dcfbc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32294,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/97ccb22e-c5f5-4f93-994a-95fd5f29d3e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35037,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/eb237f33-faa0-4dde-ac84-534336c70591_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33818,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/3eee19f3-f8f6-4d66-9fe6-5b47e785bd67_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55708,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/d3c83ff7-f36c-4b56-b460-46c6c44efdef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62548,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/5c06c5c1-594d-49e0-a205-82ab2e1bbec1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50787,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/cfe4c55a-939f-4597-8402-c76df63dccde_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53492,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/ea0dd6ab-5f36-4d07-a733-c826ec5a606a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf/7c3bb1a1-ae00-58a1-a961-79e1cf8edcdf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54537,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BF73UZU/2025-11-27/image/e5277d38-e14d-4a4f-8736-5b7217894a9e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto',
 'transmission': 'automatic',
 'trim': '1.6 TGDi Plug-in Hybrid Ultimate 5dr 4WD Auto',
 'vin': None,
 'year': 2023}
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209835%27 HTTP/1.1" 200 None
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Saving data for 117209835: {'created_time': 1764270076.567663, 'last_price_update_time': 1764270076.567672, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117209835') HTTP/1.1" 204 0
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22YMW/2025-11-26/image/fbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117355965?view=catalogue)
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117239774
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239774%27 HTTP/1.1" 200 None
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117239774: 0
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117332454
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117332454%27 HTTP/1.1" 200 None
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117332454: 2
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116888300?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 116889879
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116889879%27 HTTP/1.1" 200 None
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Scrape type for 116889879: 0
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 116469065
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116469065%27 HTTP/1.1" 200 None
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Scrape type for 116469065: 2
2025-11-27 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0b5050>
2025-11-27 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT71TGO/2025-11-27/image/51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117260206?view=catalogue)
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117491214?view=catalogue)
2025-11-27 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP21HGD/2025-11-26/image/ed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117521004?view=catalogue)
2025-11-27 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 116609338
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116609338%27 HTTP/1.1" 200 None
2025-11-27 19:01:17 [astonbarclay.gb] INFO: Scrape type for 116609338: 2
2025-11-27 19:01:17 [astonbarclay.gb] INFO: Found listing with ID: 117445900
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117445900%27 HTTP/1.1" 200 None
2025-11-27 19:01:17 [astonbarclay.gb] INFO: Scrape type for 117445900: 0
2025-11-27 19:01:17 [astonbarclay.gb] INFO: Found listing with ID: 116672171
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116672171%27 HTTP/1.1" 200 None
2025-11-27 19:01:17 [astonbarclay.gb] INFO: Scrape type for 116672171: 2
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe95010>
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec2f2d0>
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fea3910>
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c71e290>
2025-11-27 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252Fa9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecda3d0>
2025-11-27 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22YMW%252F2025-11-26%252Fimage%252Ffbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22YMW/2025-11-26/image/fbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7
2025-11-27 19:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a467cd0f-4a93-5513-9d5a-9e6f47614eb7, skipping ID generation
2025-11-27 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7 with scrape type 1
2025-11-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a467cd0f-4a93-5513-9d5a-9e6f47614eb7 from tracking dictionaries
2025-11-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a467cd0f-4a93-5513-9d5a-9e6f47614eb7 sending to next pipeline
2025-11-27 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a467cd0f-4a93-5513-9d5a-9e6f47614eb7, identifier: 117355965
2025-11-27 19:01:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116888300, 'registration': 'GJ74UZH', 'account': 'MOT070', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '218i [136] M Sport 4dr DCT', 'mileage': 17260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2742, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1499, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/1090ab76-2b06-4c7f-8eac-1927e78b2833_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/0c0d731f-9020-4a1b-95a4-55249ae174e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/cf8e7781-7889-43d3-866e-ef9bfdac1eff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/1edcfc6f-b7a4-48d9-b74c-b46b024bd5f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/b1852455-0b78-49a3-b642-48cd9b2d773e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/511fcdc4-afd6-48db-a3c9-3cbc1b9a69d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/65450796-23ec-4040-9e89-e7379c9606f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/9f86161d-d485-415f-b8af-cd5e1fc1727f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/d31e930c-d4f1-41ce-88a5-0715f1f3dfe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/43f40b26-02a1-4e7a-b0c4-722f00a80c13_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/b9caea78-1b3d-4ea0-b5bf-262cae25d7a2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/25 14K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88106b76-5d2a-4b45-be6a-065d646eb24e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116888300, 'registration': 'GJ74UZH', 'account': 'MOT070', 'make': 'BMW', 'model': '2 SERIES GRAN COUPE', 'derivative': '218i [136] M Sport 4dr DCT', 'mileage': 17260, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2742, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1499, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/1090ab76-2b06-4c7f-8eac-1927e78b2833_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/0c0d731f-9020-4a1b-95a4-55249ae174e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/cf8e7781-7889-43d3-866e-ef9bfdac1eff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/1edcfc6f-b7a4-48d9-b74c-b46b024bd5f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/b1852455-0b78-49a3-b642-48cd9b2d773e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/511fcdc4-afd6-48db-a3c9-3cbc1b9a69d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/65450796-23ec-4040-9e89-e7379c9606f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/9f86161d-d485-415f-b8af-cd5e1fc1727f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/d31e930c-d4f1-41ce-88a5-0715f1f3dfe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/43f40b26-02a1-4e7a-b0c4-722f00a80c13_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ74UZH/2025-11-04/image/b9caea78-1b3d-4ea0-b5bf-262cae25d7a2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/25 14K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88106b76-5d2a-4b45-be6a-065d646eb24e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d with identifier: 116888300
2025-11-27 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d with scrape type 2
2025-11-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d with scrape type 2
2025-11-27 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d, identifier: 116888300
2025-11-27 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 116931130
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931130%27 HTTP/1.1" 200 None
2025-11-27 19:01:18 [astonbarclay.gb] INFO: Scrape type for 116931130: 2
2025-11-27 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a467cd0f-4a93-5513-9d5a-9e6f47614eb7 with identifier: 117355965
2025-11-27 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a467cd0f-4a93-5513-9d5a-9e6f47614eb7 with identifier: 117355965
2025-11-27 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a467cd0f-4a93-5513-9d5a-9e6f47614eb7 with identifier: 117355965 to the API
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DV22YMW/2025-11-26/image/fbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a467cd0f-4a93-5513-9d5a-9e6f47614eb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV22YMW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117355965',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 5317,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29430,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/fbff92d8-ec05-458b-99ca-1f3200aaf8b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33829,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/4af721a1-09a3-427b-9bc9-2993d0382200_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33554,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/b20c62a4-8410-4b80-be47-1b54d37526fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36081,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/07f194e1-a943-44e3-9298-dca268526367_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54087,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/5eda990a-107d-4fc6-ab7f-a0c9b0e508a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56723,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/979c15e4-04ba-4cdf-a02b-6b5198b83882_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49415,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/cf717a2f-6c1d-4b11-8f67-4ffd4ca927a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53490,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/31f14cf7-f01a-4946-a487-a0580da0a241_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a467cd0f-4a93-5513-9d5a-9e6f47614eb7/a467cd0f-4a93-5513-9d5a-9e6f47614eb7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51369,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22YMW/2025-11-26/image/c03a6401-113a-477b-80d0-dda68f13cc8f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-30',
 'seller_name': 'Zenith',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 TGDi SE Connect 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 TGDi SE Connect 5dr 2WD',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117355965%27 HTTP/1.1" 200 None
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Saving data for 117355965: {'created_time': 1764270079.035492, 'last_price_update_time': 1764270079.035501, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117355965') HTTP/1.1" 204 0
2025-11-27 19:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d with identifier: 116888300
2025-11-27 19:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d with identifier: 116888300
2025-11-27 19:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d with identifier: 116888300 to the API
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116888300?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6a50c7ac-1d3c-5a5b-8684-aa3d83607b5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GJ74UZH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116888300',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 17260,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': 'Motability Operations',
 'title': 'BMW 2 SERIES GRAN COUPE 218i [136] M Sport 4dr DCT',
 'transmission': 'automatic',
 'trim': '218i [136] M Sport 4dr DCT',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116888300%27 HTTP/1.1" 200 None
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Saving data for 116888300: {'auction_closing_time': 1764583200.0, 'created_time': 1763579032.378727, 'last_price_update_time': 1764270079.359663}
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116888300') HTTP/1.1" 204 0
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117146277
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117146277%27 HTTP/1.1" 200 None
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117146277: 2
2025-11-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117322438?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117185317?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131580?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117183059?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114912508?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116797614?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116025987?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117326858
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117326858%27 HTTP/1.1" 200 None
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117326858: 0
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117410325
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117410325%27 HTTP/1.1" 200 None
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117410325: 0
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 116754864
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116754864%27 HTTP/1.1" 200 None
2025-11-27 19:01:19 [astonbarclay.gb] INFO: Scrape type for 116754864: 2
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec79d90>
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT71TGO%252F2025-11-27%252Fimage%252F51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT71TGO/2025-11-27/image/51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90
2025-11-27 19:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2910a99b-7c30-572e-bf19-b9f7d54f0c90, skipping ID generation
2025-11-27 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90 with scrape type 1
2025-11-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2910a99b-7c30-572e-bf19-b9f7d54f0c90 from tracking dictionaries
2025-11-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2910a99b-7c30-572e-bf19-b9f7d54f0c90 sending to next pipeline
2025-11-27 19:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2910a99b-7c30-572e-bf19-b9f7d54f0c90, identifier: 117260206
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb07710>
2025-11-27 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSN71VCZ%252F2025-11-25%252Fimage%252F4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f327b62c-8ae3-540a-a75b-0cad22be2279
2025-11-27 19:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f327b62c-8ae3-540a-a75b-0cad22be2279, skipping ID generation
2025-11-27 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f327b62c-8ae3-540a-a75b-0cad22be2279 with scrape type 1
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f327b62c-8ae3-540a-a75b-0cad22be2279 from tracking dictionaries
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f327b62c-8ae3-540a-a75b-0cad22be2279 sending to next pipeline
2025-11-27 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f327b62c-8ae3-540a-a75b-0cad22be2279, identifier: 117491214
2025-11-27 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec24f90>
2025-11-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP21HGD%252F2025-11-26%252Fimage%252Fed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP21HGD/2025-11-26/image/ed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4
2025-11-27 19:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4, skipping ID generation
2025-11-27 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 with scrape type 1
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 from tracking dictionaries
2025-11-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 sending to next pipeline
2025-11-27 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4, identifier: 117521004
2025-11-27 19:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2910a99b-7c30-572e-bf19-b9f7d54f0c90 with identifier: 117260206
2025-11-27 19:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2910a99b-7c30-572e-bf19-b9f7d54f0c90 with identifier: 117260206
2025-11-27 19:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2910a99b-7c30-572e-bf19-b9f7d54f0c90 with identifier: 117260206 to the API
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MT71TGO/2025-11-27/image/51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '2910a99b-7c30-572e-bf19-b9f7d54f0c90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MT71TGO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117260206',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 32128,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 18114,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/51de8732-00d5-41b8-a27d-daa1d32ecda7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19405,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14d5a8b8-d347-4c9d-b47a-98a62441fedb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21838,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/93de05e9-25ff-4cea-807e-22665994749a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21102,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/85ac5ca9-dad0-4084-a2e5-ea41cb848ced_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31650,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/36ba2865-d95e-4ca6-bc73-6adb6391cb43_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35680,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/14f7ccee-3820-4c9b-aea7-69cccd2eaec4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31155,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/af7470fb-1435-43fd-8ce8-2cfec279e413_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36068,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/7b1073a4-167f-41ce-9214-c8ccec45c7b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41513,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/90ab2212-1b95-4c5e-ae1f-14f77da56ed4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2910a99b-7c30-572e-bf19-b9f7d54f0c90/2910a99b-7c30-572e-bf19-b9f7d54f0c90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46940,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/MT71TGO/2025-11-27/image/9145aa2d-3211-4f90-86df-43460312654f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Standard Plus 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Standard Plus 4dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260206%27 HTTP/1.1" 200 None
2025-11-27 19:01:20 [astonbarclay.gb] INFO: Saving data for 117260206: {'created_time': 1764270080.941305, 'last_price_update_time': 1764270080.941315, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117260206') HTTP/1.1" 204 0
2025-11-27 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f327b62c-8ae3-540a-a75b-0cad22be2279 with identifier: 117491214
2025-11-27 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f327b62c-8ae3-540a-a75b-0cad22be2279 with identifier: 117491214
2025-11-27 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 64201, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw sport 80kwh 5dr auto', 'license_plate': 'sn71vcz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 20808}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 22622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 21831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 22527}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 45184}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 52915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 34386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40891}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43537}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 103321} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sn71vcz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 64201,
     'odometer_in_km': 103321,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 20808,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22622,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21831,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22527,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45184,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52915,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34386,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40891,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43537,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-07',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw sport 80kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-11-27 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: f327b62c-8ae3-540a-a75b-0cad22be2279 spider: astonbarclay.gb
2025-11-27 19:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f327b62c-8ae3-540a-a75b-0cad22be2279 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 64201, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw sport 80kwh 5dr auto', 'license_plate': 'sn71vcz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 20808}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 22622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 21831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 22527}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 45184}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 52915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 34386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40891}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 43537}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 103321} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sn71vcz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 64201,
     'odometer_in_km': 103321,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 20808,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22622,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21831,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22527,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45184,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52915,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34386,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40891,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43537,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-07',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqc estate eqc 400 300kw sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw sport 80kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'f327b62c-8ae3-540a-a75b-0cad22be2279',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SN71VCZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491214',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 64201,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20808,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/4f07d89d-9c56-4875-b0d6-2fb5cc47ff20_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22622,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a9c729d5-bb06-4680-8106-c89c235a0a16_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21831,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/6d38879f-8612-4f6e-9fd4-359250e877a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22527,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/5f7701e8-867c-49d3-9c5f-8f0327a0126a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45184,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/d683dd2f-9ebd-4bd1-9dc1-0763e45fffe3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52915,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/110400d5-94d4-4f73-aa9a-5586c87a08be_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34386,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/a5aca799-05fd-4874-877a-52b5832d344c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40891,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/92183c50-1fa9-4043-a253-11a89d003f37_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f327b62c-8ae3-540a-a75b-0cad22be2279/f327b62c-8ae3-540a-a75b-0cad22be2279_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43537,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SN71VCZ/2025-11-25/image/35ba096c-7ccb-4651-a868-ca210e164f21_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW Sport 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW Sport 80kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491214%27 HTTP/1.1" 200 None
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Saving data for 117491214: {'created_time': 1764270081.300419, 'last_price_update_time': 1764270081.300427, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117491214') HTTP/1.1" 204 0
2025-11-27 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 with identifier: 117521004
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE%2FBLACK HTTP/1.1" 200 None
2025-11-27 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 with identifier: 117521004
2025-11-27 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7b1ff772-a0e1-53bd-ad0e-b03518bd23e4 with identifier: 117521004 to the API
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DP21HGD/2025-11-26/image/ed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '7b1ff772-a0e1-53bd-ad0e-b03518bd23e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DP21HGD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117521004',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MINI',
 'model': 'COUNTRYMAN HATCHBACK',
 'odometer': 70693,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41641,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/ed54fe8e-e6d9-4c96-8bb7-3712bc1cd6bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40710,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/27934d5a-0516-4a06-afac-133ed545c239_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38992,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aad86fb2-5994-4547-876d-fa6ecc73c126_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37346,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/aa4c57c3-1c0c-4636-ab47-653ab391e986_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/0bd3320a-9a95-4da8-9047-b848d404242b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52323,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/b607e08a-42d9-4fcc-9c87-b4917cb6cf92_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44793,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/54a8c9f9-51f5-4284-b163-a9273585d9ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62833,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/8c5ad833-8025-4d8b-bf80-56ab73780c0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56998,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/868912df-390e-4408-bb26-2a7310a32c3a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b1ff772-a0e1-53bd-ad0e-b03518bd23e4/7b1ff772-a0e1-53bd-ad0e-b03518bd23e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49330,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DP21HGD/2025-11-26/image/85b3d795-636d-4e71-9fec-2683ecee35f5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-06',
 'seller_name': 'Zenith',
 'title': 'MINI COUNTRYMAN HATCHBACK 1.5 Cooper S E Classic ALL4 PHEV 5dr '
          'Auto[Comfort]',
 'transmission': 'automatic',
 'trim': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]',
 'vin': None,
 'year': 2021}
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117521004%27 HTTP/1.1" 200 None
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Saving data for 117521004: {'created_time': 1764270081.92687, 'last_price_update_time': 1764270081.92688, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117521004') HTTP/1.1" 204 0
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Found listing with ID: 116858059
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116858059%27 HTTP/1.1" 200 None
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Scrape type for 116858059: 0
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Found listing with ID: 117474277
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474277%27 HTTP/1.1" 200 None
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Scrape type for 117474277: 0
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Found listing with ID: 117187130
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117187130%27 HTTP/1.1" 200 None
2025-11-27 19:01:21 [astonbarclay.gb] INFO: Scrape type for 117187130: 2
2025-11-27 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116810166?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 116852162
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116852162%27 HTTP/1.1" 200 None
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Scrape type for 116852162: 0
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117454067
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117454067%27 HTTP/1.1" 200 None
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117454067: 0
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117182764
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117182764%27 HTTP/1.1" 200 None
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117182764: 2
2025-11-27 19:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117322438, 'registration': 'GF72TXJ', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Excite 5dr DCT', 'mileage': 48650, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2709, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/213355a7-ee93-4f5e-89f4-debece158d84_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/a7d12469-808a-4828-b6b4-8f30214eb761_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/35028e72-bd64-469c-b1a8-32a054617f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/a696c0b6-ae5d-4ea9-ae02-37b48980692f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/c1e44e52-0a15-4083-bdd0-211df4c83489_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/4370e1e0-eb8b-43fe-b0d4-f79b56d6ba92_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/1ee28430-c1dd-407e-89e0-9ef4f3bb1ca4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/21b42a95-b7c6-4385-8c61-f66e657f35ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/3ace8e44-845c-40c0-bcc0-55fe8a2bae5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/0f7ce098-556b-45c1-b803-5d9c7203378d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/23 14K - 06/24 24K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 47K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f4a58c0-23a5-4472-b750-a504321a7aae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117322438, 'registration': 'GF72TXJ', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Excite 5dr DCT', 'mileage': 48650, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2709, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-26', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/213355a7-ee93-4f5e-89f4-debece158d84_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/a7d12469-808a-4828-b6b4-8f30214eb761_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/35028e72-bd64-469c-b1a8-32a054617f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/a696c0b6-ae5d-4ea9-ae02-37b48980692f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/c1e44e52-0a15-4083-bdd0-211df4c83489_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/4370e1e0-eb8b-43fe-b0d4-f79b56d6ba92_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/1ee28430-c1dd-407e-89e0-9ef4f3bb1ca4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/21b42a95-b7c6-4385-8c61-f66e657f35ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/3ace8e44-845c-40c0-bcc0-55fe8a2bae5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF72TXJ/2025-11-19/image/0f7ce098-556b-45c1-b803-5d9c7203378d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/23 14K - 06/24 24K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 47K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f4a58c0-23a5-4472-b750-a504321a7aae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2fd4ed3-a7e7-5af4-b910-5d6b97f52934 with identifier: 117322438
2025-11-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2fd4ed3-a7e7-5af4-b910-5d6b97f52934 with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2fd4ed3-a7e7-5af4-b910-5d6b97f52934 with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2fd4ed3-a7e7-5af4-b910-5d6b97f52934, identifier: 117322438
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117185317, 'registration': 'LE25NJN', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLB ESTATE', 'derivative': 'GLB 200 Sport Executive 5dr 7G-Tronic', 'mileage': 3877, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2744, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-07-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LE25NJN/2025-11-13/image/824bfcd3-c08b-4c14-8d5b-ca0fc7cee3fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/544554fe-f32d-40e0-863b-07b98bd1afff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/c84cd22c-502f-49e0-82a6-54c3aee2333e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/c094b8b8-78e4-42e4-9506-b2a76e3986c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/b8495504-d04b-4e0c-9f20-23e3e35023c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/a2a9e642-ff2c-442b-bca9-ce9eb7d6b36f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/89077e12-480f-4f53-9d36-24826314f9cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/d08feb70-6708-4934-9f19-c997b861708c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/e696ca19-7ff2-42e8-ba21-8bdb0449e475_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/2496428f-93af-46fe-a437-f5208aa328a6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 155, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1365e00a-2449-406d-9d96-f25002ab9920.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117185317, 'registration': 'LE25NJN', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLB ESTATE', 'derivative': 'GLB 200 Sport Executive 5dr 7G-Tronic', 'mileage': 3877, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2744, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-07-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LE25NJN/2025-11-13/image/824bfcd3-c08b-4c14-8d5b-ca0fc7cee3fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/544554fe-f32d-40e0-863b-07b98bd1afff_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/c84cd22c-502f-49e0-82a6-54c3aee2333e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/c094b8b8-78e4-42e4-9506-b2a76e3986c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/b8495504-d04b-4e0c-9f20-23e3e35023c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/a2a9e642-ff2c-442b-bca9-ce9eb7d6b36f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/89077e12-480f-4f53-9d36-24826314f9cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/d08feb70-6708-4934-9f19-c997b861708c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/e696ca19-7ff2-42e8-ba21-8bdb0449e475_removebg.jpg?w=600', 'https://abimg003.imgix.net/LE25NJN/2025-11-13/image/2496428f-93af-46fe-a437-f5208aa328a6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 155, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1365e00a-2449-406d-9d96-f25002ab9920.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ca164d1-16ba-5a45-8ba8-e7458e38a260 with identifier: 117185317
2025-11-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca164d1-16ba-5a45-8ba8-e7458e38a260 with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ca164d1-16ba-5a45-8ba8-e7458e38a260 with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0ca164d1-16ba-5a45-8ba8-e7458e38a260, identifier: 117185317
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131580, 'registration': 'LL70KMF', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Premium Plus 4dr Tip Auto', 'mileage': 64591, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2743, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-02', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LL70KMF/2025-11-12/image/78206342-3ff8-4a95-abcf-2681574e2475_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/2482194d-1afc-48f0-b24a-4f450ff44069_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/aeb8c99b-a2a0-49bb-bc37-114f8c9f2ed9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/765ef7ba-9db0-4713-a4d3-8db9196dc0e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/8d04dce5-ce92-4add-a466-52b1a90eedf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/cbc730f7-ae28-486b-b768-ee35ba98f169_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/a808833f-f14c-4b1b-811f-2c87f54d2d2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/2a8c07d0-d692-43f8-af87-63e4b21e9c13_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/a189a7ad-2078-496f-8ade-739820929e22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/584be106-7bd4-40b6-84a3-274cc9b2bfce_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 12/21 15k - 01/23 33k 02/24 45k - 01/25 58k', 'remarks': 'OUTSTANDING RECALL  - VOSA STATES, 45K, 58K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/870c4b6e-59c4-4564-8e6b-511e7144bece.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131580, 'registration': 'LL70KMF', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Premium Plus 4dr Tip Auto', 'mileage': 64591, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2743, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-02', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LL70KMF/2025-11-12/image/78206342-3ff8-4a95-abcf-2681574e2475_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/2482194d-1afc-48f0-b24a-4f450ff44069_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/aeb8c99b-a2a0-49bb-bc37-114f8c9f2ed9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/765ef7ba-9db0-4713-a4d3-8db9196dc0e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/8d04dce5-ce92-4add-a466-52b1a90eedf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/cbc730f7-ae28-486b-b768-ee35ba98f169_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/a808833f-f14c-4b1b-811f-2c87f54d2d2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/2a8c07d0-d692-43f8-af87-63e4b21e9c13_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/a189a7ad-2078-496f-8ade-739820929e22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70KMF/2025-11-12/image/584be106-7bd4-40b6-84a3-274cc9b2bfce_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 12/21 15k - 01/23 33k 02/24 45k - 01/25 58k', 'remarks': 'OUTSTANDING RECALL  - VOSA STATES, 45K, 58K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/870c4b6e-59c4-4564-8e6b-511e7144bece.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c989d9-d602-51ab-94ec-28f592c135a3 with identifier: 117131580
2025-11-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c989d9-d602-51ab-94ec-28f592c135a3 with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24c989d9-d602-51ab-94ec-28f592c135a3 with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 24c989d9-d602-51ab-94ec-28f592c135a3, identifier: 117131580
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117183059, 'registration': 'EA72HBD', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure Premium 5dr EAT8', 'mileage': 44780, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2747, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Diesel', 'motExpiry': '2026-08-22', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA72HBD/2025-11-13/image/9b93ef19-2540-41b8-bcbd-7b2896b56032_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/338904ea-a6c9-46e1-ad5e-b29ad52535d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/4f2b7c88-aec8-46b1-856d-41ce928fddd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/dd105fd6-c78d-462f-b16e-856ae6d80e04_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/10b67ba9-d064-4bcd-b579-e30e37b4cf29_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/29ba5dc4-a983-44f3-a2f5-203148351e76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/108a35d5-9ade-44cb-b77e-70c04950c0bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/1b3c634d-ecc7-46f6-86d9-75fb24b5d229_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/00d0b0a1-dacd-4444-b431-0cd3b4be686c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/24 23K', 'remarks': 'VOSA STATES, 40K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/22429035-a3ab-4aa4-a760-1a5184158483.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117183059, 'registration': 'EA72HBD', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure Premium 5dr EAT8', 'mileage': 44780, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2747, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-10', 'fuel': 'Diesel', 'motExpiry': '2026-08-22', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA72HBD/2025-11-13/image/9b93ef19-2540-41b8-bcbd-7b2896b56032_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/338904ea-a6c9-46e1-ad5e-b29ad52535d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/4f2b7c88-aec8-46b1-856d-41ce928fddd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/dd105fd6-c78d-462f-b16e-856ae6d80e04_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/10b67ba9-d064-4bcd-b579-e30e37b4cf29_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/29ba5dc4-a983-44f3-a2f5-203148351e76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/108a35d5-9ade-44cb-b77e-70c04950c0bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/1b3c634d-ecc7-46f6-86d9-75fb24b5d229_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72HBD/2025-11-13/image/00d0b0a1-dacd-4444-b431-0cd3b4be686c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/24 23K', 'remarks': 'VOSA STATES, 40K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/22429035-a3ab-4aa4-a760-1a5184158483.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07a4a79-bd38-5e5c-95c2-f81bf6468eba with identifier: 117183059
2025-11-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07a4a79-bd38-5e5c-95c2-f81bf6468eba with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07a4a79-bd38-5e5c-95c2-f81bf6468eba with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c07a4a79-bd38-5e5c-95c2-f81bf6468eba, identifier: 117183059
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 114912508, 'registration': 'EJ74BEO', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 16449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2708, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/6f76c207-b5d5-4ad0-8b90-dfffee84d009_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/b4670a20-9f66-4f10-b511-d1ea9848408a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/dbeaab11-d024-4d81-acc1-21871427657a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/61598d4e-c676-46e7-8787-d2ca12e5f05d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/6954cbd7-cf50-471d-8fdd-281b1149c3db_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/d4afac7e-658c-4098-9ea2-3709511813ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/b064c438-7f60-4a51-b6b7-adf4aad9ca08_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/81d8010e-852f-4e99-a782-a6d09f318fe3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 114912508, 'registration': 'EJ74BEO', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic', 'mileage': 16449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2708, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/6f76c207-b5d5-4ad0-8b90-dfffee84d009_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/b4670a20-9f66-4f10-b511-d1ea9848408a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/dbeaab11-d024-4d81-acc1-21871427657a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/61598d4e-c676-46e7-8787-d2ca12e5f05d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/6954cbd7-cf50-471d-8fdd-281b1149c3db_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/d4afac7e-658c-4098-9ea2-3709511813ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ74BEO/2025-08-22/image/b064c438-7f60-4a51-b6b7-adf4aad9ca08_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/81d8010e-852f-4e99-a782-a6d09f318fe3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 955eb81c-29a0-55b2-b6bc-8bf04743b17a with identifier: 114912508
2025-11-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 955eb81c-29a0-55b2-b6bc-8bf04743b17a with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 955eb81c-29a0-55b2-b6bc-8bf04743b17a with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 955eb81c-29a0-55b2-b6bc-8bf04743b17a, identifier: 114912508
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116797614, 'registration': 'LS24VRF', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 17599, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2745, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-20', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LS24VRF/2025-10-31/image/23f3a25d-563b-43a4-9c2f-9dda65df37c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/c52b13ec-ef5e-40e3-887c-74ad803ab383_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/bbb198e6-c7ad-490d-8264-a771eaa95df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/5662d32c-e252-4d55-8382-f2306b9d23aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/c39c267d-4ed2-4dc0-9773-6338502e1ea7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/452961a0-120f-4a15-863b-1cfacdc6fef5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/b9163393-5e38-4f96-a369-1bd4479b81b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/9eca054f-f33d-47d0-bcc9-e338dbce07ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/88a4a908-69fb-4b7b-8fda-41f0dae614f0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/25 8K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26d479d9-48af-4a02-8336-123c055f3704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116797614, 'registration': 'LS24VRF', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 17599, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2745, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-20', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LS24VRF/2025-10-31/image/23f3a25d-563b-43a4-9c2f-9dda65df37c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/c52b13ec-ef5e-40e3-887c-74ad803ab383_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/bbb198e6-c7ad-490d-8264-a771eaa95df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/5662d32c-e252-4d55-8382-f2306b9d23aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/c39c267d-4ed2-4dc0-9773-6338502e1ea7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/452961a0-120f-4a15-863b-1cfacdc6fef5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/b9163393-5e38-4f96-a369-1bd4479b81b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/9eca054f-f33d-47d0-bcc9-e338dbce07ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24VRF/2025-10-31/image/88a4a908-69fb-4b7b-8fda-41f0dae614f0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/25 8K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26d479d9-48af-4a02-8336-123c055f3704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce15bfa7-21f4-59a9-b1af-ffc52875ac7b with identifier: 116797614
2025-11-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce15bfa7-21f4-59a9-b1af-ffc52875ac7b with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce15bfa7-21f4-59a9-b1af-ffc52875ac7b with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ce15bfa7-21f4-59a9-b1af-ffc52875ac7b, identifier: 116797614
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116025987, 'registration': 'EK23JTV', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.5 E-Power 204 Acenta Premium 5dr Xtronic', 'mileage': 13221, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2746, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-03-06', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/EK23JTV/2025-11-14/image/c318a103-5dc7-472f-844d-e67622c294e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/19646a29-0520-47e3-93b7-f9d510953bcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/058be4d9-09b8-43ee-8253-17f3ac727d17_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/e571d281-1bb0-4911-8bf6-bfd20e26c126_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/5efd78aa-c57c-4d9e-b577-3123116fcbb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/25869c3c-f53c-4470-b631-dd7a04f2a10c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/e21c6133-7e72-40ff-9140-9b599df83122_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/ee9cbfc8-d269-4673-81a6-54943b5c17d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/787875cb-45df-4ec0-a583-f197c2208481_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/24 6k - 06/25 11k', 'remarks': 'ADAPTION REMOVED - HAND CONTROLS', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/87e07faf-66b4-4494-b9c9-9735d31404bb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116025987, 'registration': 'EK23JTV', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.5 E-Power 204 Acenta Premium 5dr Xtronic', 'mileage': 13221, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2746, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-03-06', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/EK23JTV/2025-11-14/image/c318a103-5dc7-472f-844d-e67622c294e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/19646a29-0520-47e3-93b7-f9d510953bcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/058be4d9-09b8-43ee-8253-17f3ac727d17_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/e571d281-1bb0-4911-8bf6-bfd20e26c126_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/5efd78aa-c57c-4d9e-b577-3123116fcbb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/25869c3c-f53c-4470-b631-dd7a04f2a10c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/e21c6133-7e72-40ff-9140-9b599df83122_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/ee9cbfc8-d269-4673-81a6-54943b5c17d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK23JTV/2025-11-14/image/787875cb-45df-4ec0-a583-f197c2208481_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/24 6k - 06/25 11k', 'remarks': 'ADAPTION REMOVED - HAND CONTROLS', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/87e07faf-66b4-4494-b9c9-9735d31404bb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd67fe7-a3a7-570f-a89a-e1d78459619b with identifier: 116025987
2025-11-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd67fe7-a3a7-570f-a89a-e1d78459619b with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd67fe7-a3a7-570f-a89a-e1d78459619b with scrape type 2
2025-11-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6cd67fe7-a3a7-570f-a89a-e1d78459619b, identifier: 116025987
2025-11-27 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2fd4ed3-a7e7-5af4-b910-5d6b97f52934 with identifier: 117322438
2025-11-27 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2fd4ed3-a7e7-5af4-b910-5d6b97f52934 with identifier: 117322438
2025-11-27 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c2fd4ed3-a7e7-5af4-b910-5d6b97f52934 with identifier: 117322438 to the API
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117322438?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c2fd4ed3-a7e7-5af4-b910-5d6b97f52934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF72TXJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117322438',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 48650,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Excite 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Excite 5dr DCT',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117322438%27 HTTP/1.1" 200 None
2025-11-27 19:01:23 [astonbarclay.gb] INFO: Saving data for 117322438: {'auction_closing_time': 1764583200.0, 'created_time': 1763579073.352191, 'last_price_update_time': 1764270083.07181}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117322438') HTTP/1.1" 204 0
2025-11-27 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0ca164d1-16ba-5a45-8ba8-e7458e38a260 with identifier: 117185317
2025-11-27 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0ca164d1-16ba-5a45-8ba8-e7458e38a260 with identifier: 117185317
2025-11-27 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0ca164d1-16ba-5a45-8ba8-e7458e38a260 with identifier: 117185317 to the API
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117185317?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0ca164d1-16ba-5a45-8ba8-e7458e38a260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LE25NJN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117185317',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLB ESTATE',
 'odometer': 3877,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-30',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLB ESTATE GLB 200 Sport Executive 5dr 7G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLB 200 Sport Executive 5dr 7G-Tronic',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185317%27 HTTP/1.1" 200 None
2025-11-27 19:01:23 [astonbarclay.gb] INFO: Saving data for 117185317: {'auction_closing_time': 1764583200.0, 'created_time': 1763579036.624204, 'last_price_update_time': 1764270083.387027}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117185317') HTTP/1.1" 204 0
2025-11-27 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 24c989d9-d602-51ab-94ec-28f592c135a3 with identifier: 117131580
2025-11-27 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 24c989d9-d602-51ab-94ec-28f592c135a3 with identifier: 117131580
2025-11-27 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 24c989d9-d602-51ab-94ec-28f592c135a3 with identifier: 117131580 to the API
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117131580?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '24c989d9-d602-51ab-94ec-28f592c135a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL70KMF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131580',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 64591,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 180 AMG Line Premium Plus 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 180 AMG Line Premium Plus 4dr Tip Auto',
 'vin': None,
 'year': 2020}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131580%27 HTTP/1.1" 200 None
2025-11-27 19:01:23 [astonbarclay.gb] INFO: Saving data for 117131580: {'auction_closing_time': 1764583200.0, 'created_time': 1762974241.142677, 'last_price_update_time': 1764270083.664315}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131580') HTTP/1.1" 204 0
2025-11-27 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c07a4a79-bd38-5e5c-95c2-f81bf6468eba with identifier: 117183059
2025-11-27 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c07a4a79-bd38-5e5c-95c2-f81bf6468eba with identifier: 117183059
2025-11-27 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c07a4a79-bd38-5e5c-95c2-f81bf6468eba with identifier: 117183059 to the API
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117183059?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c07a4a79-bd38-5e5c-95c2-f81bf6468eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA72HBD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117183059',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '5008 DIESEL ESTATE',
 'odometer': 44780,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 5008 DIESEL ESTATE 1.5 BlueHDi Allure Premium 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure Premium 5dr EAT8',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183059%27 HTTP/1.1" 200 None
2025-11-27 19:01:23 [astonbarclay.gb] INFO: Saving data for 117183059: {'auction_closing_time': 1764583200.0, 'created_time': 1763579036.195046, 'last_price_update_time': 1764270083.94364}
2025-11-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117183059') HTTP/1.1" 204 0
2025-11-27 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 955eb81c-29a0-55b2-b6bc-8bf04743b17a with identifier: 114912508
2025-11-27 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 955eb81c-29a0-55b2-b6bc-8bf04743b17a with identifier: 114912508
2025-11-27 19:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 955eb81c-29a0-55b2-b6bc-8bf04743b17a with identifier: 114912508 to the API
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/114912508?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '955eb81c-29a0-55b2-b6bc-8bf04743b17a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ74BEO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114912508',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 16449,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-29',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 Acenta Premium 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Acenta Premium 5dr Xtronic',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114912508%27 HTTP/1.1" 200 None
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Saving data for 114912508: {'auction_closing_time': 1764583200.0, 'created_time': 1761160081.593818, 'last_price_update_time': 1764270084.323655}
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114912508') HTTP/1.1" 204 0
2025-11-27 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ce15bfa7-21f4-59a9-b1af-ffc52875ac7b with identifier: 116797614
2025-11-27 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ce15bfa7-21f4-59a9-b1af-ffc52875ac7b with identifier: 116797614
2025-11-27 19:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ce15bfa7-21f4-59a9-b1af-ffc52875ac7b with identifier: 116797614 to the API
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116797614?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ce15bfa7-21f4-59a9-b1af-ffc52875ac7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS24VRF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116797614',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 17599,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-20',
 'seller_name': 'Motability Operations',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116797614%27 HTTP/1.1" 200 None
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Saving data for 116797614: {'auction_closing_time': 1764583200.0, 'created_time': 1763579074.375946, 'last_price_update_time': 1764270084.60837}
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116797614') HTTP/1.1" 204 0
2025-11-27 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6cd67fe7-a3a7-570f-a89a-e1d78459619b with identifier: 116025987
2025-11-27 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6cd67fe7-a3a7-570f-a89a-e1d78459619b with identifier: 116025987
2025-11-27 19:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6cd67fe7-a3a7-570f-a89a-e1d78459619b with identifier: 116025987 to the API
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116025987?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '6cd67fe7-a3a7-570f-a89a-e1d78459619b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK23JTV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116025987',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'X-TRAIL STATION WAGON',
 'odometer': 13221,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-06',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN X-TRAIL STATION WAGON 1.5 E-Power 204 Acenta Premium 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.5 E-Power 204 Acenta Premium 5dr Xtronic',
 'vin': None,
 'year': 2023}
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116025987%27 HTTP/1.1" 200 None
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Saving data for 116025987: {'auction_closing_time': 1764583200.0, 'created_time': 1763233288.072758, 'last_price_update_time': 1764270084.889413}
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116025987') HTTP/1.1" 204 0
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Found listing with ID: 117537741
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537741%27 HTTP/1.1" 200 None
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Scrape type for 117537741: 0
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Found listing with ID: 117079893
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079893%27 HTTP/1.1" 200 None
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Scrape type for 117079893: 2
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116810166, 'registration': 'CE23ONL', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech GT 5dr', 'mileage': 21098, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2751, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-03-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CE23ONL/2025-10-30/image/1b66b353-2097-45cd-bd75-828874aff3df_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/b35c273c-c237-4558-a96e-1d0a9b8096d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/11684f98-79b9-41d4-b1fd-f1a69e058970_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/a56cda91-5a5b-4d36-b641-13d7bf89dcb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/7cd0e151-2123-437e-9f76-808c613ce65d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/a672b272-e84c-49fd-a839-d79d52cd9f57_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/435d731e-4d86-4eee-8a6a-dc0396508a89_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/120fdc5e-fbd5-4e9b-80e0-28a9843990ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/d865e265-1f4e-4e0b-8134-bae3a9ad5880_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/247f75cb-8ce5-4276-a829-ae3e05e06c4b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/24 8K - 02/25 16K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - DOCUMENT REFERENCE NUMBER AVAILABLE ON REQUEST - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c363fdf1-afdd-4f01-85e7-8f0fb7c7bcb3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116810166, 'registration': 'CE23ONL', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech GT 5dr', 'mileage': 21098, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2751, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-03-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CE23ONL/2025-10-30/image/1b66b353-2097-45cd-bd75-828874aff3df_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/b35c273c-c237-4558-a96e-1d0a9b8096d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/11684f98-79b9-41d4-b1fd-f1a69e058970_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/a56cda91-5a5b-4d36-b641-13d7bf89dcb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/7cd0e151-2123-437e-9f76-808c613ce65d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/a672b272-e84c-49fd-a839-d79d52cd9f57_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/435d731e-4d86-4eee-8a6a-dc0396508a89_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/120fdc5e-fbd5-4e9b-80e0-28a9843990ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/d865e265-1f4e-4e0b-8134-bae3a9ad5880_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE23ONL/2025-10-30/image/247f75cb-8ce5-4276-a829-ae3e05e06c4b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/24 8K - 02/25 16K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - DOCUMENT REFERENCE NUMBER AVAILABLE ON REQUEST - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c363fdf1-afdd-4f01-85e7-8f0fb7c7bcb3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e11dcb-3bd2-5f98-8edd-a76a81371d48 with identifier: 116810166
2025-11-27 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e11dcb-3bd2-5f98-8edd-a76a81371d48 with scrape type 2
2025-11-27 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e11dcb-3bd2-5f98-8edd-a76a81371d48 with scrape type 2
2025-11-27 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f1e11dcb-3bd2-5f98-8edd-a76a81371d48, identifier: 116810166
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec8b150>
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fbb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe73650>
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252Fa8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117538127
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117538127%27 HTTP/1.1" 200 None
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117538127: 0
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117239915
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239915%27 HTTP/1.1" 200 None
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117239915: 0
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 116412555
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116412555%27 HTTP/1.1" 200 None
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Scrape type for 116412555: 0
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117247318
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117247318%27 HTTP/1.1" 200 None
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117247318: 0
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117290404
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290404%27 HTTP/1.1" 200 None
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117290404: 2
2025-11-27 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f1e11dcb-3bd2-5f98-8edd-a76a81371d48 with identifier: 116810166
2025-11-27 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f1e11dcb-3bd2-5f98-8edd-a76a81371d48 with identifier: 116810166
2025-11-27 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f1e11dcb-3bd2-5f98-8edd-a76a81371d48 with identifier: 116810166 to the API
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116810166?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f1e11dcb-3bd2-5f98-8edd-a76a81371d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CE23ONL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116810166',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '5008 ESTATE',
 'odometer': 21098,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 5008 ESTATE 1.2 PureTech GT 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech GT 5dr',
 'vin': None,
 'year': 2023}
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116810166%27 HTTP/1.1" 200 None
2025-11-27 19:01:25 [astonbarclay.gb] INFO: Saving data for 116810166: {'auction_closing_time': 1764583200.0, 'created_time': 1762283987.25402, 'last_price_update_time': 1764270085.927736}
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116810166') HTTP/1.1" 204 0
2025-11-27 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117274456?view=catalogue)
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117428083
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117428083%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117428083: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117443695
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117443695%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117443695: 2
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117169584
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117169584%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117169584: 2
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117416217
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416217%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117416217: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117492493
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492493%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117492493: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117518338
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117518338%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117518338: 1
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117256710
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256710%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117256710: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117024373
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024373%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117024373: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117077436
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117077436%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117077436: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117339017
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339017%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117339017: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117156921
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117156921%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117156921: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117351302
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117351302%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117351302: 2
2025-11-27 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d412650>
2025-11-27 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYH71XFK%252F2025-11-26%252Fimage%252F7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e89d2341-6d61-5d14-92f3-065fa0676120
2025-11-27 19:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e89d2341-6d61-5d14-92f3-065fa0676120, skipping ID generation
2025-11-27 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89d2341-6d61-5d14-92f3-065fa0676120 with scrape type 1
2025-11-27 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e89d2341-6d61-5d14-92f3-065fa0676120 from tracking dictionaries
2025-11-27 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e89d2341-6d61-5d14-92f3-065fa0676120 sending to next pipeline
2025-11-27 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e89d2341-6d61-5d14-92f3-065fa0676120, identifier: 117274456
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116802225
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116802225%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116802225: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116674717
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674717%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116674717: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116601112
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116601112%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116601112: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116409684
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116409684%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116409684: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117245171
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117245171%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117245171: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116377459
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116377459%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116377459: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116859641
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859641%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116859641: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116572254
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116572254%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116572254: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117215946
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215946%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117215946: 0
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 116707815
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116707815%27 HTTP/1.1" 200 None
2025-11-27 19:01:26 [astonbarclay.gb] INFO: Scrape type for 116707815: 1
2025-11-27 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e89d2341-6d61-5d14-92f3-065fa0676120 with identifier: 117274456
2025-11-27 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e89d2341-6d61-5d14-92f3-065fa0676120 with identifier: 117274456
2025-11-27 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'up electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22957, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '60kw e-up 32kwh 5dr auto', 'license_plate': 'yh71xfk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e89d2341-6d61-5d14-92f3-065fa0676120', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30422}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33687}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54461}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 65554}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52122}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volkswagen up electric hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 36945} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'e89d2341-6d61-5d14-92f3-065fa0676120',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yh71xfk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen up electric hatchback',
     'model': 'up electric hatchback',
     'odometer': 22957,
     'odometer_in_km': 36945,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33579,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33881,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32010,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30422,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33687,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54461,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46741,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65554,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52122,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-10',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '60kw e-up 32kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-11-27 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: e89d2341-6d61-5d14-92f3-065fa0676120 spider: astonbarclay.gb
2025-11-27 19:01:27 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e89d2341-6d61-5d14-92f3-065fa0676120 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'up electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 22957, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '60kw e-up 32kwh 5dr auto', 'license_plate': 'yh71xfk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e89d2341-6d61-5d14-92f3-065fa0676120', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30422}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33687}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54461}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 65554}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52122}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'volkswagen up electric hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 36945} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'e89d2341-6d61-5d14-92f3-065fa0676120',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yh71xfk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'volkswagen',
     'make_model': 'volkswagen up electric hatchback',
     'model': 'up electric hatchback',
     'odometer': 22957,
     'odometer_in_km': 36945,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33579,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33881,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32010,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30422,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33687,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54461,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46741,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65554,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52122,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-10',
     'sanitized_make': 'volkswagen',
     'seller_name': 'zenith',
     'title': 'volkswagen up electric hatchback 60kw e-up 32kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '60kw e-up 32kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'e89d2341-6d61-5d14-92f3-065fa0676120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YH71XFK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274456',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'UP ELECTRIC HATCHBACK',
 'odometer': 22957,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33579,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/0ed0ae8c-985a-4f2c-9264-4a417602e333_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33881,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/8966f331-34c0-4140-a5af-e5f0a4292250_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32010,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/7e0301c4-bbdf-47f9-a707-1010a27af1c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30422,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/a8e818a2-50e5-41bb-bfbf-dc1729bdb1e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33687,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/06dfba76-d5b8-4503-861f-0be4cf1845cd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54461,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/32fa04cf-32b0-43db-9d86-1f4f089f074e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46741,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/9b7f4c78-36b7-4ebb-afa3-249832faa1df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65554,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/c4ccf4d4-30dc-46e3-aa5e-f71c09f94f40_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d2341-6d61-5d14-92f3-065fa0676120/e89d2341-6d61-5d14-92f3-065fa0676120_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52122,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YH71XFK/2025-11-26/image/75a0bbe5-6646-46c2-9f7c-6998f782c1a1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seller_name': 'Zenith',
 'title': 'VOLKSWAGEN UP ELECTRIC HATCHBACK 60kW E-Up 32kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '60kW E-Up 32kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274456%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Saving data for 117274456: {'created_time': 1764270087.048048, 'last_price_update_time': 1764270087.048055, 'auction_closing_time': 1764323100.0}
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117274456') HTTP/1.1" 204 0
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 116894508
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116894508%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 116894508: 1
2025-11-27 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116806926?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 116937928
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116937928%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 116937928: 1
2025-11-27 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 116988307
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 116988307: 1
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117012889
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117012889%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117012889: 1
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116806926, 'registration': 'YS24UWR', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 38744, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2748, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS24UWR/2025-10-31/image/0ddb5364-7027-4f2e-822c-4fd2bd0118df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e6c72461-f424-4ef8-87a7-37161335c3c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7f97e2e5-31c5-4cc9-a691-54db7f471f24_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/3f0969fb-274d-4066-869f-2133b4b812cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/d566eab5-7e85-4fdf-83f0-5f53703cb374_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/45e0bea6-3a63-43f2-8712-3da64037803f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e1503e49-499d-402e-ad34-abecac7ea18d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7c222871-b778-42cc-afac-477a95dbce3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/fbd546d1-caca-4059-a85b-9dc7a4854e36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/df5badaa-10f6-4bcb-97da-94b49ba70e2d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/25 26K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a2dfa4a-571c-4b9b-803c-cd1651107f73.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116806926, 'registration': 'YS24UWR', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 38744, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2748, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS24UWR/2025-10-31/image/0ddb5364-7027-4f2e-822c-4fd2bd0118df_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e6c72461-f424-4ef8-87a7-37161335c3c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7f97e2e5-31c5-4cc9-a691-54db7f471f24_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/3f0969fb-274d-4066-869f-2133b4b812cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/d566eab5-7e85-4fdf-83f0-5f53703cb374_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/45e0bea6-3a63-43f2-8712-3da64037803f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/e1503e49-499d-402e-ad34-abecac7ea18d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/7c222871-b778-42cc-afac-477a95dbce3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/fbd546d1-caca-4059-a85b-9dc7a4854e36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS24UWR/2025-10-31/image/df5badaa-10f6-4bcb-97da-94b49ba70e2d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/25 26K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a2dfa4a-571c-4b9b-803c-cd1651107f73.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926
2025-11-27 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with scrape type 2
2025-11-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with scrape type 2
2025-11-27 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a, identifier: 116806926
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117536653
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536653%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117536653: 0
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117506685
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506685%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117506685: 0
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117516097
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516097%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117516097: 1
2025-11-27 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926
2025-11-27 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926
2025-11-27 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0a0182ff-ce23-5245-b563-6ff4f95b5d1a with identifier: 116806926 to the API
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116806926?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0a0182ff-ce23-5245-b563-6ff4f95b5d1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS24UWR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116806926',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'ATECA ESTATE',
 'odometer': 38744,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-15',
 'seller_name': 'Motability Operations',
 'title': 'SEAT ATECA ESTATE 1.5 TSI EVO Xperience 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI EVO Xperience 5dr DSG',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116806926%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Saving data for 116806926: {'auction_closing_time': 1764583200.0, 'created_time': 1763579029.309191, 'last_price_update_time': 1764270087.842835}
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116806926') HTTP/1.1" 204 0
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117540120
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540120%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117540120: 1
2025-11-27 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117231987?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116469065?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116943613?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116753648?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116223544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117493882
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493882%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117493882: 0
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117488710
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488710%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117488710: 0
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117506767
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506767%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117506767: 1
2025-11-27 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117514309
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514309%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117514309: 0
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117543969
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543969%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117543969: 1
2025-11-27 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117332454?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117539662
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539662%27 HTTP/1.1" 200 None
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117539662: 1
2025-11-27 19:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117540360
2025-11-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540360%27 HTTP/1.1" 200 None
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Scrape type for 117540360: 1
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117231987, 'registration': 'PF71XFO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo SRi Premium 5dr Auto', 'mileage': 23204, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2705, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-03', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PF71XFO/2025-11-17/image/20f24314-291f-4bcd-a70e-fc34c907598b_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/0402682a-bfc9-4383-9363-c67c21f38fb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/439d3d52-c16b-4e5d-b15b-f29bb9244191_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/59f40e87-b043-4026-acf2-2b381dbad84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/f5f0c09c-e9e8-4e2c-91b6-b1bcf88108b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/89ff3707-2078-4d68-b831-817836656b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/ac93a2d0-d152-4e79-a734-ba7cbaf86dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/04a5cfe1-3157-4f08-9bea-562f286911f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/5c205b02-efb5-462c-a92a-f4669089bbe7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/424a3a2e-33b2-4545-8134-5282e3031efb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/23 6K - 02/24 12K - 12/24 27K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 19K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b4d8a3a-a49b-4788-83d6-89c2c36fa37b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117231987, 'registration': 'PF71XFO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo SRi Premium 5dr Auto', 'mileage': 23204, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2705, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-01-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-03', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PF71XFO/2025-11-17/image/20f24314-291f-4bcd-a70e-fc34c907598b_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/0402682a-bfc9-4383-9363-c67c21f38fb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/439d3d52-c16b-4e5d-b15b-f29bb9244191_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/59f40e87-b043-4026-acf2-2b381dbad84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/f5f0c09c-e9e8-4e2c-91b6-b1bcf88108b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/89ff3707-2078-4d68-b831-817836656b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/ac93a2d0-d152-4e79-a734-ba7cbaf86dac_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/04a5cfe1-3157-4f08-9bea-562f286911f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/5c205b02-efb5-462c-a92a-f4669089bbe7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF71XFO/2025-11-17/image/424a3a2e-33b2-4545-8134-5282e3031efb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/23 6K - 02/24 12K - 12/24 27K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 19K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4b4d8a3a-a49b-4788-83d6-89c2c36fa37b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f911ab5-9f34-5606-8beb-977e9f5bd7f5 with identifier: 117231987
2025-11-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f911ab5-9f34-5606-8beb-977e9f5bd7f5 with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f911ab5-9f34-5606-8beb-977e9f5bd7f5 with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6f911ab5-9f34-5606-8beb-977e9f5bd7f5, identifier: 117231987
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116469065, 'registration': 'EF74VGA', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.0 TSI SE L Edition 5dr', 'mileage': 10515, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2758, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-02-11', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF74VGA/2025-10-29/image/95bba95f-de26-4b62-b72d-dbe1818eda9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/8c2736cf-9311-4a04-93ec-930cafe164ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/fb2f1c14-175c-4b68-ba82-0f55f368eaea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/29512506-d08b-40f6-8399-114a94031229_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/44190f17-9d8e-4768-aa72-33aca4244eaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/c102b0a0-85b6-47d6-b151-06d89e93da92_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/d91b96cf-ae91-4215-8691-fc6983cb050f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/e0e4fa99-5013-44cf-88c6-59400b8222f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/55317590-17ec-41af-b322-3dad52ed3f76_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3738d681-8687-4151-b962-e9d54a242ad3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116469065, 'registration': 'EF74VGA', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.0 TSI SE L Edition 5dr', 'mileage': 10515, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2758, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-02-11', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF74VGA/2025-10-29/image/95bba95f-de26-4b62-b72d-dbe1818eda9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/8c2736cf-9311-4a04-93ec-930cafe164ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/fb2f1c14-175c-4b68-ba82-0f55f368eaea_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/29512506-d08b-40f6-8399-114a94031229_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/44190f17-9d8e-4768-aa72-33aca4244eaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/c102b0a0-85b6-47d6-b151-06d89e93da92_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/d91b96cf-ae91-4215-8691-fc6983cb050f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/e0e4fa99-5013-44cf-88c6-59400b8222f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF74VGA/2025-10-29/image/55317590-17ec-41af-b322-3dad52ed3f76_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3738d681-8687-4151-b962-e9d54a242ad3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61092939-8852-5169-830e-3b93da0e142b with identifier: 116469065
2025-11-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61092939-8852-5169-830e-3b93da0e142b with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61092939-8852-5169-830e-3b93da0e142b with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61092939-8852-5169-830e-3b93da0e142b, identifier: 116469065
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116943613, 'registration': 'GF25UHL', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI Life 5dr DSG', 'mileage': 2587, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2706, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-05-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF25UHL/2025-11-05/image/9f5c7b9f-f74f-4cde-91ca-07cdf637e12c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/26ed7fc7-3eda-4daa-9662-df6d246bf938_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/bec73491-bad0-46a6-96ae-416b0193f776_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/35f6f7ff-44a9-4aff-a65e-5442979b7ca6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/df341cd4-265c-491c-bde1-93ca6417cb0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/aa33c9a7-e75e-4878-a308-2ab3d4c24c8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/13cd754a-06d2-4d47-90d3-f51f2555e1f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/93c23251-cea8-4c86-9b9c-9042a46af327_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/91b2421a-0ce9-4cea-947c-deca2ff64452_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/f25fc255-526e-4735-84a3-deba1ba633ae_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe878a21-f95a-4e4b-95cc-0ce94cebda6d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116943613, 'registration': 'GF25UHL', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI Life 5dr DSG', 'mileage': 2587, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2706, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-05-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF25UHL/2025-11-05/image/9f5c7b9f-f74f-4cde-91ca-07cdf637e12c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/26ed7fc7-3eda-4daa-9662-df6d246bf938_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/bec73491-bad0-46a6-96ae-416b0193f776_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/35f6f7ff-44a9-4aff-a65e-5442979b7ca6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/df341cd4-265c-491c-bde1-93ca6417cb0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/aa33c9a7-e75e-4878-a308-2ab3d4c24c8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/13cd754a-06d2-4d47-90d3-f51f2555e1f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/93c23251-cea8-4c86-9b9c-9042a46af327_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/91b2421a-0ce9-4cea-947c-deca2ff64452_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF25UHL/2025-11-05/image/f25fc255-526e-4735-84a3-deba1ba633ae_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe878a21-f95a-4e4b-95cc-0ce94cebda6d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da148b40-d3f0-5d84-b8bb-7bf27aa099df with identifier: 116943613
2025-11-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da148b40-d3f0-5d84-b8bb-7bf27aa099df with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da148b40-d3f0-5d84-b8bb-7bf27aa099df with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: da148b40-d3f0-5d84-b8bb-7bf27aa099df, identifier: 116943613
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116753648, 'registration': 'EN24YEX', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 17289, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2753, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-07-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN24YEX/2025-11-06/image/b4ddc847-8c00-49fe-8474-3f4134464bb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/5dd63941-6995-4e91-8a4e-ea091af0486f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/e119386f-0a0a-4407-956c-c335b76c0cf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/7037834e-4008-40c0-aa1e-3dca4b40d652_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/bcff14b3-b118-433e-bd5a-44644eafdd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/443ffea6-a999-4bbf-ba77-0d6a3d8e574f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/da7934dd-9bec-4601-bcc6-979182520513_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/a7fd318e-0701-491f-8cf2-42709270b39d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/739c4380-5918-4523-9aff-8bbac2831476_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/cc623b46-eac4-47a8-9bd9-2c207ae8e799_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a56a757b-d6d9-43db-bcb2-2da52a6c10d9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116753648, 'registration': 'EN24YEX', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 17289, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2753, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-07-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN24YEX/2025-11-06/image/b4ddc847-8c00-49fe-8474-3f4134464bb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/5dd63941-6995-4e91-8a4e-ea091af0486f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/e119386f-0a0a-4407-956c-c335b76c0cf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/7037834e-4008-40c0-aa1e-3dca4b40d652_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/bcff14b3-b118-433e-bd5a-44644eafdd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/443ffea6-a999-4bbf-ba77-0d6a3d8e574f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/da7934dd-9bec-4601-bcc6-979182520513_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/a7fd318e-0701-491f-8cf2-42709270b39d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/739c4380-5918-4523-9aff-8bbac2831476_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN24YEX/2025-11-06/image/cc623b46-eac4-47a8-9bd9-2c207ae8e799_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a56a757b-d6d9-43db-bcb2-2da52a6c10d9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa70c1e9-613b-530e-9f97-2a4a08ce4281 with identifier: 116753648
2025-11-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa70c1e9-613b-530e-9f97-2a4a08ce4281 with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa70c1e9-613b-530e-9f97-2a4a08ce4281 with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fa70c1e9-613b-530e-9f97-2a4a08ce4281, identifier: 116753648
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116223544, 'registration': 'EN74GMY', 'account': 'MOT070', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 9284, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2754, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-02-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN74GMY/2025-11-25/image/819c2303-4fbe-4607-971c-684c6e5ebbbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/166cd454-31ea-4728-8f3c-6c15fd98aba7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/af020432-baad-4fb4-bf37-bf4795d8c163_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/2fa4c6f2-5500-4d49-9f54-3e38d9b3e70d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/070b8008-f3af-4472-99c6-2988dc799a5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/cbc61b5d-234b-441b-b10d-ba94941fd4ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/c12035e6-5898-4955-9f19-a9724a440e4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/8e1b67ea-056e-4e49-8a39-3a8c6f32a2d3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa10b950-11cc-4c5e-936b-5b77cf2b82d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116223544, 'registration': 'EN74GMY', 'account': 'MOT070', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 9284, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2754, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-02-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN74GMY/2025-11-25/image/819c2303-4fbe-4607-971c-684c6e5ebbbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/166cd454-31ea-4728-8f3c-6c15fd98aba7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/af020432-baad-4fb4-bf37-bf4795d8c163_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/2fa4c6f2-5500-4d49-9f54-3e38d9b3e70d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/070b8008-f3af-4472-99c6-2988dc799a5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/cbc61b5d-234b-441b-b10d-ba94941fd4ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/c12035e6-5898-4955-9f19-a9724a440e4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN74GMY/2025-11-25/image/8e1b67ea-056e-4e49-8a39-3a8c6f32a2d3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa10b950-11cc-4c5e-936b-5b77cf2b82d1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 014dd66d-23be-5b08-a7bf-907b0826e9be with identifier: 116223544
2025-11-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 014dd66d-23be-5b08-a7bf-907b0826e9be with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 014dd66d-23be-5b08-a7bf-907b0826e9be with scrape type 2
2025-11-27 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 014dd66d-23be-5b08-a7bf-907b0826e9be, identifier: 116223544
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Found listing with ID: 117367599
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117367599%27 HTTP/1.1" 200 None
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Scrape type for 117367599: 0
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Found listing with ID: 117447787
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447787%27 HTTP/1.1" 200 None
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Scrape type for 117447787: 1
2025-11-27 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6f911ab5-9f34-5606-8beb-977e9f5bd7f5 with identifier: 117231987
2025-11-27 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6f911ab5-9f34-5606-8beb-977e9f5bd7f5 with identifier: 117231987
2025-11-27 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6f911ab5-9f34-5606-8beb-977e9f5bd7f5 with identifier: 117231987 to the API
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276f911ab5-9f34-5606-8beb-977e9f5bd7f5%27 HTTP/1.1" 200 None
2025-11-27 19:01:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6f911ab5-9f34-5606-8beb-977e9f5bd7f5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117231987?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6f911ab5-9f34-5606-8beb-977e9f5bd7f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PF71XFO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117231987',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 23204,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.2 Turbo SRi Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo SRi Premium 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117231987%27 HTTP/1.1" 200 None
2025-11-27 19:01:28 [astonbarclay.gb] INFO: Saving data for 117231987: {'auction_closing_time': 1764583200.0, 'created_time': 1763147167.534565, 'last_price_update_time': 1764270088.789588}
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117231987') HTTP/1.1" 204 0
2025-11-27 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61092939-8852-5169-830e-3b93da0e142b with identifier: 116469065
2025-11-27 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61092939-8852-5169-830e-3b93da0e142b with identifier: 116469065
2025-11-27 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 61092939-8852-5169-830e-3b93da0e142b with identifier: 116469065 to the API
2025-11-27 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116469065?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '61092939-8852-5169-830e-3b93da0e142b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF74VGA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116469065',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KAMIQ HATCHBACK',
 'odometer': 10515,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-11',
 'seller_name': 'Motability Operations',
 'title': 'SKODA KAMIQ HATCHBACK 1.0 TSI SE L Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI SE L Edition 5dr',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116469065%27 HTTP/1.1" 200 None
2025-11-27 19:01:29 [astonbarclay.gb] INFO: Saving data for 116469065: {'auction_closing_time': 1764583200.0, 'created_time': 1763578999.435098, 'last_price_update_time': 1764270089.169165}
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116469065') HTTP/1.1" 204 0
2025-11-27 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: da148b40-d3f0-5d84-b8bb-7bf27aa099df with identifier: 116943613
2025-11-27 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: da148b40-d3f0-5d84-b8bb-7bf27aa099df with identifier: 116943613
2025-11-27 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: da148b40-d3f0-5d84-b8bb-7bf27aa099df with identifier: 116943613 to the API
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116943613?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'da148b40-d3f0-5d84-b8bb-7bf27aa099df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF25UHL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116943613',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 2587,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-30',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 TSI Life 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI Life 5dr DSG',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116943613%27 HTTP/1.1" 200 None
2025-11-27 19:01:29 [astonbarclay.gb] INFO: Saving data for 116943613: {'auction_closing_time': 1764583200.0, 'created_time': 1762888043.272187, 'last_price_update_time': 1764270089.464308}
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116943613') HTTP/1.1" 204 0
2025-11-27 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fa70c1e9-613b-530e-9f97-2a4a08ce4281 with identifier: 116753648
2025-11-27 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fa70c1e9-613b-530e-9f97-2a4a08ce4281 with identifier: 116753648
2025-11-27 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fa70c1e9-613b-530e-9f97-2a4a08ce4281 with identifier: 116753648 to the API
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116753648?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fa70c1e9-613b-530e-9f97-2a4a08ce4281',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN24YEX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116753648',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 17289,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116753648%27 HTTP/1.1" 200 None
2025-11-27 19:01:29 [astonbarclay.gb] INFO: Saving data for 116753648: {'auction_closing_time': 1764583200.0, 'created_time': 1763579074.043177, 'last_price_update_time': 1764270089.743975}
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116753648') HTTP/1.1" 204 0
2025-11-27 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 014dd66d-23be-5b08-a7bf-907b0826e9be with identifier: 116223544
2025-11-27 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 014dd66d-23be-5b08-a7bf-907b0826e9be with identifier: 116223544
2025-11-27 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 014dd66d-23be-5b08-a7bf-907b0826e9be with identifier: 116223544 to the API
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116223544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '014dd66d-23be-5b08-a7bf-907b0826e9be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN74GMY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116223544',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 9284,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-18',
 'seller_name': 'Motability Operations',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116223544%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Saving data for 116223544: {'auction_closing_time': 1764583200.0, 'created_time': 1762888038.723809, 'last_price_update_time': 1764270090.014609}
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116223544') HTTP/1.1" 204 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117079065
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079065%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117079065: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117455255
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455255%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117455255: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117271901
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271901%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117271901: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117403044
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403044%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117403044: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117498519
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498519%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117498519: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117498468
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498468%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117498468: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117498427
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498427%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117498427: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117505585
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505585%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117505585: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117217399
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217399%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117217399: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117408595
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117408595%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117408595: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117425377
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117425377: 2
2025-11-27 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117053964?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117542466
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542466%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117542466: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117498571
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498571%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117498571: 2
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117332454, 'registration': 'WF22FWG', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.5 Hybrid SZ-T 5dr AGS', 'mileage': 10423, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2756, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 1462, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WF22FWG/2025-11-19/image/d3da9784-e3d3-4306-ae9c-4a67d9890abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/7dd0e0f3-e316-4cfb-b496-86f33e69c22a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/90088f90-533d-4266-8fe9-c5211798d0cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/5ed15268-38be-437b-b92e-64b02b34571a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/c1c095b2-38e3-4d18-812f-3f6cae666299_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/a0f871e0-ed29-456c-81ac-296e15dc961b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/aff7cf79-6975-467a-80db-ce657f2e9e2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/d6c56d87-7087-4e20-aa76-a12f9705c528_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/a1996725-d035-4e4e-92f7-868433c000c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/54da7fb0-0d3a-46dd-a6e3-0366958acade_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 4K - 06/24 7K - 06/25 9K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 9K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5b6701f1-5227-40b8-a4d8-2281d502a34c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117332454, 'registration': 'WF22FWG', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.5 Hybrid SZ-T 5dr AGS', 'mileage': 10423, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2756, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 1462, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WF22FWG/2025-11-19/image/d3da9784-e3d3-4306-ae9c-4a67d9890abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/7dd0e0f3-e316-4cfb-b496-86f33e69c22a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/90088f90-533d-4266-8fe9-c5211798d0cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/5ed15268-38be-437b-b92e-64b02b34571a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/c1c095b2-38e3-4d18-812f-3f6cae666299_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/a0f871e0-ed29-456c-81ac-296e15dc961b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/aff7cf79-6975-467a-80db-ce657f2e9e2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/d6c56d87-7087-4e20-aa76-a12f9705c528_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/a1996725-d035-4e4e-92f7-868433c000c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF22FWG/2025-11-19/image/54da7fb0-0d3a-46dd-a6e3-0366958acade_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 4K - 06/24 7K - 06/25 9K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 9K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5b6701f1-5227-40b8-a4d8-2281d502a34c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3680e03-bab7-5831-974a-bf2be0d52ed4 with identifier: 117332454
2025-11-27 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3680e03-bab7-5831-974a-bf2be0d52ed4 with scrape type 2
2025-11-27 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3680e03-bab7-5831-974a-bf2be0d52ed4 with scrape type 2
2025-11-27 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e3680e03-bab7-5831-974a-bf2be0d52ed4, identifier: 117332454
2025-11-27 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e3680e03-bab7-5831-974a-bf2be0d52ed4 with identifier: 117332454
2025-11-27 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e3680e03-bab7-5831-974a-bf2be0d52ed4 with identifier: 117332454
2025-11-27 19:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e3680e03-bab7-5831-974a-bf2be0d52ed4 with identifier: 117332454 to the API
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117332454?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'e3680e03-bab7-5831-974a-bf2be0d52ed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WF22FWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117332454',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SUZUKI',
 'model': 'VITARA ESTATE',
 'odometer': 10423,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-20',
 'seller_name': 'Motability Operations',
 'title': 'SUZUKI VITARA ESTATE 1.5 Hybrid SZ-T 5dr AGS',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid SZ-T 5dr AGS',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117332454%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Saving data for 117332454: {'auction_closing_time': 1764583200.0, 'created_time': 1763579036.957993, 'last_price_update_time': 1764270090.642624}
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117332454') HTTP/1.1" 204 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117406735
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406735%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117406735: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 116509919
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 116509919: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117459821
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459821%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117459821: 0
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117425501
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425501%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117425501: 2
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117311708
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117311708: 2
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117053964, 'registration': 'RJ74FWL', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 1622, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2752, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-11-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/5146e507-a26e-440c-9ddc-4c0e725a4971_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/eb8bd756-fe4e-4f48-b9ac-d7a92ee554e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/cdf47ffb-957c-4445-ab5f-2a730f494e2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/73c43854-4717-4494-86bf-9c162ece51f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/896ac8b2-6b7a-4f59-8dfc-73fa8ae0f2f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/ea8aa47a-4cbe-4cba-9503-acb590c950a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/b305e620-57f4-47d3-a20e-7f5e9b86d2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/0adfd610-d0f7-4850-982a-a627f2a8873c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/b7291ada-4a2c-4b7f-9ad2-920f47dd0b36_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a60d5cef-1b5f-4864-9ff7-8fb42ff0453f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117053964, 'registration': 'RJ74FWL', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 1622, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2752, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-11-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/5146e507-a26e-440c-9ddc-4c0e725a4971_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/eb8bd756-fe4e-4f48-b9ac-d7a92ee554e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/cdf47ffb-957c-4445-ab5f-2a730f494e2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/73c43854-4717-4494-86bf-9c162ece51f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/896ac8b2-6b7a-4f59-8dfc-73fa8ae0f2f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/ea8aa47a-4cbe-4cba-9503-acb590c950a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/b305e620-57f4-47d3-a20e-7f5e9b86d2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/0adfd610-d0f7-4850-982a-a627f2a8873c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RJ74FWL/2025-11-12/image/b7291ada-4a2c-4b7f-9ad2-920f47dd0b36_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a60d5cef-1b5f-4864-9ff7-8fb42ff0453f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91705228-6a4f-521f-87bc-22790d62cc25 with identifier: 117053964
2025-11-27 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91705228-6a4f-521f-87bc-22790d62cc25 with scrape type 2
2025-11-27 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91705228-6a4f-521f-87bc-22790d62cc25 with scrape type 2
2025-11-27 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 91705228-6a4f-521f-87bc-22790d62cc25, identifier: 117053964
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117420560
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420560%27 HTTP/1.1" 200 None
2025-11-27 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117420560: 2
2025-11-27 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 91705228-6a4f-521f-87bc-22790d62cc25 with identifier: 117053964
2025-11-27 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 91705228-6a4f-521f-87bc-22790d62cc25 with identifier: 117053964
2025-11-27 19:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 91705228-6a4f-521f-87bc-22790d62cc25 with identifier: 117053964 to the API
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117053964?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '91705228-6a4f-521f-87bc-22790d62cc25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RJ74FWL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117053964',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'AVENGER HATCHBACK',
 'odometer': 1622,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-29',
 'seller_name': 'Motability Operations',
 'title': 'JEEP AVENGER HATCHBACK 1.2 e-Hybrid Summit 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.2 e-Hybrid Summit 5dr DCT',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117053964%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Saving data for 117053964: {'auction_closing_time': 1764583200.0, 'created_time': 1763579070.384189, 'last_price_update_time': 1764270091.640067}
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117053964') HTTP/1.1" 204 0
2025-11-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117146277?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117452123
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117452123: 2
2025-11-27 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116609338?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116754864?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117187130?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116611908?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116931130?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117452490
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117452490: 2
2025-11-27 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117184599
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117184599%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117184599: 2
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117061078
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061078%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117061078: 2
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117357391
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117357391: 2
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117276677
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117276677: 2
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117310723
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117310723: 2
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117146277, 'registration': 'LT21GWE', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Tekna 5dr DCT', 'mileage': 23778, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2763, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT21GWE/2025-11-13/image/ca9b9b1e-d662-432a-9f1c-0cbf65ce21b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/f68e6310-0462-4716-8698-ba6bcb7e93c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/9d3db688-d36d-4bd4-b485-720059491472_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/edf3e92d-a298-4d84-8379-5df53854d948_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/d24992cd-fd02-4bd6-9c0d-ca7ca73bd91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/af6aad50-5d15-479f-98aa-c3a0494c0da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/8118dca9-9bcf-40ee-b913-78a80020f6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/dfb27b35-f74d-4324-bf67-e5363c875a7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/9ec5b368-86f3-4553-8abc-64ac563996d1_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/22 10K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b67bcdee-dc95-4a93-bfab-21b8fcf01799.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117146277, 'registration': 'LT21GWE', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Tekna 5dr DCT', 'mileage': 23778, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2763, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT21GWE/2025-11-13/image/ca9b9b1e-d662-432a-9f1c-0cbf65ce21b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/f68e6310-0462-4716-8698-ba6bcb7e93c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/9d3db688-d36d-4bd4-b485-720059491472_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/edf3e92d-a298-4d84-8379-5df53854d948_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/d24992cd-fd02-4bd6-9c0d-ca7ca73bd91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/af6aad50-5d15-479f-98aa-c3a0494c0da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/8118dca9-9bcf-40ee-b913-78a80020f6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/dfb27b35-f74d-4324-bf67-e5363c875a7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT21GWE/2025-11-13/image/9ec5b368-86f3-4553-8abc-64ac563996d1_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/22 10K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b67bcdee-dc95-4a93-bfab-21b8fcf01799.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cdd4ec6-d33e-5b52-9c88-bf71323591fb with identifier: 117146277
2025-11-27 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cdd4ec6-d33e-5b52-9c88-bf71323591fb with scrape type 2
2025-11-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cdd4ec6-d33e-5b52-9c88-bf71323591fb with scrape type 2
2025-11-27 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1cdd4ec6-d33e-5b52-9c88-bf71323591fb, identifier: 117146277
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117452073
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452073%27 HTTP/1.1" 200 None
2025-11-27 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117452073: 2
2025-11-27 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1cdd4ec6-d33e-5b52-9c88-bf71323591fb with identifier: 117146277
2025-11-27 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1cdd4ec6-d33e-5b52-9c88-bf71323591fb with identifier: 117146277
2025-11-27 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1cdd4ec6-d33e-5b52-9c88-bf71323591fb with identifier: 117146277 to the API
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117146277?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1cdd4ec6-d33e-5b52-9c88-bf71323591fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT21GWE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117146277',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 23778,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-19',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 Tekna 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0 DiG-T 114 Tekna 5dr DCT',
 'vin': None,
 'year': 2021}
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117146277%27 HTTP/1.1" 200 None
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Saving data for 117146277: {'auction_closing_time': 1764583200.0, 'created_time': 1763579075.548963, 'last_price_update_time': 1764270092.195288}
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117146277') HTTP/1.1" 204 0
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116609338, 'registration': 'LJ74ZLS', 'account': 'MOT070', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B4P Plus Dark 5dr Auto', 'mileage': 2945, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2759, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/0ad9e8d9-3bbb-480b-9e1e-6bb3e512c236_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/bb424168-5969-4406-ab49-99a2c1412ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/59a30045-333f-479b-be1e-d970aa9e3daf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/b3ad0b27-44aa-4920-a18d-f15d1c94f890_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/5a3ccd0a-4d9a-4768-b73e-8e3fc0fdeff9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/3312cce3-2cd0-453f-b5fc-04775f7fdccd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/4dd71478-affa-4a47-867d-f45c9c081da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/4393b82f-a236-4958-8cbd-2aedf83be39f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/51f28e73-76de-4cdf-a584-0d12dda2742c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/3ed0488e-d3cf-4122-86ba-154df918efed_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ebfe8167-2657-4502-9be8-dd4ef9be0c67.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116609338, 'registration': 'LJ74ZLS', 'account': 'MOT070', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '2.0 B4P Plus Dark 5dr Auto', 'mileage': 2945, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2759, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/0ad9e8d9-3bbb-480b-9e1e-6bb3e512c236_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/bb424168-5969-4406-ab49-99a2c1412ee5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/59a30045-333f-479b-be1e-d970aa9e3daf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/b3ad0b27-44aa-4920-a18d-f15d1c94f890_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/5a3ccd0a-4d9a-4768-b73e-8e3fc0fdeff9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/3312cce3-2cd0-453f-b5fc-04775f7fdccd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/4dd71478-affa-4a47-867d-f45c9c081da5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/4393b82f-a236-4958-8cbd-2aedf83be39f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/51f28e73-76de-4cdf-a584-0d12dda2742c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ74ZLS/2025-10-24/image/3ed0488e-d3cf-4122-86ba-154df918efed_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ebfe8167-2657-4502-9be8-dd4ef9be0c67.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18413d48-9aed-5278-9c45-46c4b7cdc0ec with identifier: 116609338
2025-11-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18413d48-9aed-5278-9c45-46c4b7cdc0ec with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18413d48-9aed-5278-9c45-46c4b7cdc0ec with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 18413d48-9aed-5278-9c45-46c4b7cdc0ec, identifier: 116609338
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116754864, 'registration': 'LT73CNY', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.5 E-Power 204 N-Connecta 5dr Xtronic', 'mileage': 20140, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2766, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-09-25', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LT73CNY/2025-10-29/image/b67a5d06-13fe-44d0-b471-45903f3f93c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/8aa02fe7-827e-451a-a47e-35b241f9db05_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/f3f2c687-da09-4db9-a39b-ab0cea8c50dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/7bd6ffe6-b6e2-41b5-aaa8-77af0c966d05_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/d31b400c-855e-4cde-a4bc-448325ba3473_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/9a336d85-369d-4b73-90dd-6617fccbb272_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/ee098a18-f193-445d-b1ae-5f1525d5c8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/2f8b910b-fe08-432b-a53e-3560407dd69e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/239a2789-845f-41e7-b74c-cedeb69ac800_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/bce47448-7f12-46c2-a0e5-c575296509a3_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 9K - 07/25 17K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f511404-5ea1-43f1-b269-b3a9eb2eae93.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116754864, 'registration': 'LT73CNY', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.5 E-Power 204 N-Connecta 5dr Xtronic', 'mileage': 20140, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2766, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-09-25', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1497, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LT73CNY/2025-10-29/image/b67a5d06-13fe-44d0-b471-45903f3f93c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/8aa02fe7-827e-451a-a47e-35b241f9db05_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/f3f2c687-da09-4db9-a39b-ab0cea8c50dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/7bd6ffe6-b6e2-41b5-aaa8-77af0c966d05_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/d31b400c-855e-4cde-a4bc-448325ba3473_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/9a336d85-369d-4b73-90dd-6617fccbb272_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/ee098a18-f193-445d-b1ae-5f1525d5c8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/2f8b910b-fe08-432b-a53e-3560407dd69e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/239a2789-845f-41e7-b74c-cedeb69ac800_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT73CNY/2025-10-29/image/bce47448-7f12-46c2-a0e5-c575296509a3_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 9K - 07/25 17K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f511404-5ea1-43f1-b269-b3a9eb2eae93.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923ee48e-5780-59e9-b808-bcd381a5402a with identifier: 116754864
2025-11-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923ee48e-5780-59e9-b808-bcd381a5402a with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 923ee48e-5780-59e9-b808-bcd381a5402a with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 923ee48e-5780-59e9-b808-bcd381a5402a, identifier: 116754864
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117187130, 'registration': 'LP69DHO', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'CADDY MAXI LIFE C20 DIESEL ESTATE', 'derivative': '2.0 TDI 5dr DSG', 'mileage': 35637, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2769, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-01-20', 'fuel': 'Diesel', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP69DHO/2025-11-27/image/58907c8f-d80b-476e-953e-1479c156805e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/4f415af1-7258-49a7-8701-450afd7c3858_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/a84c9487-d2b7-42ea-ad94-6459bbd8e727_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/c86d2460-8497-43c4-aebb-ccf3b5005d51_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/fd44da4b-a8b0-47ec-9489-e9fb7f5bc9b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/bf1b6a0f-602c-4a54-a334-caffffbc518b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/4326df2d-321c-4fed-b5c3-1d308678bea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/fbebbd48-d011-4132-bcc2-ce61c1c83575_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/33efa4df-ffcb-4d65-8fdf-77b4d8bd5382_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/d2a97758-8fe5-4ad0-8d27-93825703dacd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/a0022cc8-cb3b-4a8e-a8e0-544a9c8d9e32_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print', 'remarks': 'VOSA STATES 18K- 21K - 28K - 35K -ADAPTION REMOVED - HOIST', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/90bfaf11-9b58-4d4f-8a9b-3e20725c3a31.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117187130, 'registration': 'LP69DHO', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'CADDY MAXI LIFE C20 DIESEL ESTATE', 'derivative': '2.0 TDI 5dr DSG', 'mileage': 35637, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2769, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-01-20', 'fuel': 'Diesel', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP69DHO/2025-11-27/image/58907c8f-d80b-476e-953e-1479c156805e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/4f415af1-7258-49a7-8701-450afd7c3858_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/a84c9487-d2b7-42ea-ad94-6459bbd8e727_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/c86d2460-8497-43c4-aebb-ccf3b5005d51_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/fd44da4b-a8b0-47ec-9489-e9fb7f5bc9b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/bf1b6a0f-602c-4a54-a334-caffffbc518b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/4326df2d-321c-4fed-b5c3-1d308678bea9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/fbebbd48-d011-4132-bcc2-ce61c1c83575_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/33efa4df-ffcb-4d65-8fdf-77b4d8bd5382_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/d2a97758-8fe5-4ad0-8d27-93825703dacd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DHO/2025-11-27/image/a0022cc8-cb3b-4a8e-a8e0-544a9c8d9e32_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print', 'remarks': 'VOSA STATES 18K- 21K - 28K - 35K -ADAPTION REMOVED - HOIST', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/90bfaf11-9b58-4d4f-8a9b-3e20725c3a31.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc5448f6-fee1-5694-98b7-e89fa00322f5 with identifier: 117187130
2025-11-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc5448f6-fee1-5694-98b7-e89fa00322f5 with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc5448f6-fee1-5694-98b7-e89fa00322f5 with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cc5448f6-fee1-5694-98b7-e89fa00322f5, identifier: 117187130
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116611908, 'registration': 'LT24TUA', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'MEGANE E-TECH HATCHBACK', 'derivative': 'EV60 160kW Techno+ 60kWh Optimum Charge 5dr Auto', 'mileage': 39330, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2702, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-26', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT24TUA/2025-10-24/image/ebd4c58c-0a67-4c5a-b5a4-90638a207d3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/56d00ff9-6cba-4f4a-988e-194334583c49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/d01ea013-d754-4c91-ba3e-50599ce2a2b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/7991b48a-b267-4a30-964f-5fca70b745a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/5b57e0b7-c1f4-4f38-80a9-c31ce6aa1b1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/9357029c-b554-4648-96d0-05831b092d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/f65e480f-d827-469e-9051-5e9a02a2dff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/ed2f927a-b06f-4dff-a31f-94aebdf4cfe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/3d0a91f5-6593-49dd-8f70-f91445addc56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/48e94d81-0c2e-4c29-8b33-3440d213b103_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/acd21426-aad0-4105-8a7c-512057c18887_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/efa45b2d-de76-4a35-8041-b57431fbd607.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116611908, 'registration': 'LT24TUA', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'MEGANE E-TECH HATCHBACK', 'derivative': 'EV60 160kW Techno+ 60kWh Optimum Charge 5dr Auto', 'mileage': 39330, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2702, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-26', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT24TUA/2025-10-24/image/ebd4c58c-0a67-4c5a-b5a4-90638a207d3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/56d00ff9-6cba-4f4a-988e-194334583c49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/d01ea013-d754-4c91-ba3e-50599ce2a2b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/7991b48a-b267-4a30-964f-5fca70b745a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/5b57e0b7-c1f4-4f38-80a9-c31ce6aa1b1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/9357029c-b554-4648-96d0-05831b092d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/f65e480f-d827-469e-9051-5e9a02a2dff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/ed2f927a-b06f-4dff-a31f-94aebdf4cfe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/3d0a91f5-6593-49dd-8f70-f91445addc56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/48e94d81-0c2e-4c29-8b33-3440d213b103_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT24TUA/2025-10-24/image/acd21426-aad0-4105-8a7c-512057c18887_removebg.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/efa45b2d-de76-4a35-8041-b57431fbd607.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e5cb8e6-51ea-5988-842d-e09d68f8d163 with identifier: 116611908
2025-11-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e5cb8e6-51ea-5988-842d-e09d68f8d163 with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e5cb8e6-51ea-5988-842d-e09d68f8d163 with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e5cb8e6-51ea-5988-842d-e09d68f8d163, identifier: 116611908
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116931130, 'registration': 'EN22AYE', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ESTATE', 'derivative': '2.0 TSI 4Motion Elegance 5dr DSG', 'mileage': 40696, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2762, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN22AYE/2025-11-05/image/48e5a1cb-325a-491f-bb45-b24bbbe10333_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/c1b916aa-512a-4cae-abde-438e33752bfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/f609cfb0-a4b4-4c27-8408-175b3e7b74c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/3ae33940-6df8-4f8f-8a9c-bee30c7190e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/7f95f197-07ba-49e9-81f5-437dc93e8cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/8933c578-133c-4d52-9da1-64a726c69c9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/e2230f83-7adb-46ad-8b6e-88fc2f05e041_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/62005243-5aa5-4626-9071-f4b168f0c8d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/77634405-25b4-4b92-97c6-2d966beb2ca6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/8c11f3ba-8cbb-49d2-8894-71a80df10fea_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/24 14K - 03/25 31K', 'remarks': 'VOSA STATES, 36K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 192, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4e14e6f-69ca-4155-81c7-f2efe9f1c7fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116931130, 'registration': 'EN22AYE', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN ESTATE', 'derivative': '2.0 TSI 4Motion Elegance 5dr DSG', 'mileage': 40696, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2762, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EN22AYE/2025-11-05/image/48e5a1cb-325a-491f-bb45-b24bbbe10333_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/c1b916aa-512a-4cae-abde-438e33752bfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/f609cfb0-a4b4-4c27-8408-175b3e7b74c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/3ae33940-6df8-4f8f-8a9c-bee30c7190e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/7f95f197-07ba-49e9-81f5-437dc93e8cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/8933c578-133c-4d52-9da1-64a726c69c9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/e2230f83-7adb-46ad-8b6e-88fc2f05e041_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/62005243-5aa5-4626-9071-f4b168f0c8d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/77634405-25b4-4b92-97c6-2d966beb2ca6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN22AYE/2025-11-05/image/8c11f3ba-8cbb-49d2-8894-71a80df10fea_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/24 14K - 03/25 31K', 'remarks': 'VOSA STATES, 36K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 192, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4e14e6f-69ca-4155-81c7-f2efe9f1c7fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab34f37e-2ec6-5536-80fc-097ae5d40659 with identifier: 116931130
2025-11-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab34f37e-2ec6-5536-80fc-097ae5d40659 with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab34f37e-2ec6-5536-80fc-097ae5d40659 with scrape type 2
2025-11-27 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ab34f37e-2ec6-5536-80fc-097ae5d40659, identifier: 116931130
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Found listing with ID: 117569819
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-11-27 19:01:32 [astonbarclay.gb] INFO: Scrape type for 117569819: 1
2025-11-27 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 18413d48-9aed-5278-9c45-46c4b7cdc0ec with identifier: 116609338
2025-11-27 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 18413d48-9aed-5278-9c45-46c4b7cdc0ec with identifier: 116609338
2025-11-27 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 18413d48-9aed-5278-9c45-46c4b7cdc0ec with identifier: 116609338 to the API
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116609338?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '18413d48-9aed-5278-9c45-46c4b7cdc0ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LJ74ZLS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116609338',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLVO',
 'model': 'XC40 ESTATE',
 'odometer': 2945,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-15',
 'seller_name': 'Motability Operations',
 'title': 'VOLVO XC40 ESTATE 2.0 B4P Plus Dark 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 B4P Plus Dark 5dr Auto',
 'vin': None,
 'year': 2025}
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116609338%27 HTTP/1.1" 200 None
2025-11-27 19:01:33 [astonbarclay.gb] INFO: Saving data for 116609338: {'auction_closing_time': 1764583200.0, 'created_time': 1762765341.786955, 'last_price_update_time': 1764270093.09561}
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116609338') HTTP/1.1" 204 0
2025-11-27 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 923ee48e-5780-59e9-b808-bcd381a5402a with identifier: 116754864
2025-11-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 923ee48e-5780-59e9-b808-bcd381a5402a with identifier: 116754864
2025-11-27 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 923ee48e-5780-59e9-b808-bcd381a5402a with identifier: 116754864 to the API
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116754864?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '923ee48e-5780-59e9-b808-bcd381a5402a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT73CNY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116754864',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'X-TRAIL STATION WAGON',
 'odometer': 20140,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN X-TRAIL STATION WAGON 1.5 E-Power 204 N-Connecta 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.5 E-Power 204 N-Connecta 5dr Xtronic',
 'vin': None,
 'year': 2023}
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116754864%27 HTTP/1.1" 200 None
2025-11-27 19:01:33 [astonbarclay.gb] INFO: Saving data for 116754864: {'auction_closing_time': 1764583200.0, 'created_time': 1762765404.506276, 'last_price_update_time': 1764270093.3836}
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116754864') HTTP/1.1" 204 0
2025-11-27 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cc5448f6-fee1-5694-98b7-e89fa00322f5 with identifier: 117187130
2025-11-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cc5448f6-fee1-5694-98b7-e89fa00322f5 with identifier: 117187130
2025-11-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy maxi life c20 diesel estate' containing 'caddy'
2025-11-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cc5448f6-fee1-5694-98b7-e89fa00322f5 spider: astonbarclay.gb
2025-11-27 19:01:33 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: cc5448f6-fee1-5694-98b7-e89fa00322f5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy maxi life c20 diesel estate' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cc5448f6-fee1-5694-98b7-e89fa00322f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP69DHO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117187130',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'CADDY MAXI LIFE C20 DIESEL ESTATE',
 'odometer': 35637,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN CADDY MAXI LIFE C20 DIESEL ESTATE 2.0 TDI 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 5dr DSG',
 'vin': None,
 'year': 2020}
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117187130%27 HTTP/1.1" 200 None
2025-11-27 19:01:33 [astonbarclay.gb] INFO: Saving data for 117187130: {'auction_closing_time': 1764583200.0, 'created_time': 1763060623.336582, 'last_price_update_time': 1764270093.599866}
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117187130') HTTP/1.1" 204 0
2025-11-27 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e5cb8e6-51ea-5988-842d-e09d68f8d163 with identifier: 116611908
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY%2FBLACK HTTP/1.1" 200 None
2025-11-27 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e5cb8e6-51ea-5988-842d-e09d68f8d163 with identifier: 116611908
2025-11-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault megane e-tech hatchback ev60 160kw techno+ 60kwh optimum charge 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'megane e-tech hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 39330, 'odometer_reading_unit': 'mi', 'registration_date': '2024-04-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116611908', 'expiration_date': '2025-12-01t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'ev60 160kw techno+ 60kwh optimum charge 5dr auto', 'license_plate': 'lt24tua', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '2e5cb8e6-51ea-5988-842d-e09d68f8d163', 'current_year_diff': 1, 'age_in_months': 19, 'make_model': 'renault megane e-tech hatchback', 'sanitized_make': 'renault', 'odometer_in_km': 63295} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 19,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-01t10:00:00z',
     'fuel_type': 'electric',
     'id': '2e5cb8e6-51ea-5988-842d-e09d68f8d163',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lt24tua',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116611908',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'renault',
     'make_model': 'renault megane e-tech hatchback',
     'model': 'megane e-tech hatchback',
     'odometer': 39330,
     'odometer_in_km': 63295,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-04-26',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault megane e-tech hatchback ev60 160kw techno+ 60kwh '
              'optimum charge 5dr auto',
     'transmission': 'automatic',
     'trim': 'ev60 160kw techno+ 60kwh optimum charge 5dr auto',
     'vin': None,
     'year': 2024}
2025-11-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 2e5cb8e6-51ea-5988-842d-e09d68f8d163 spider: astonbarclay.gb
2025-11-27 19:01:33 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 2e5cb8e6-51ea-5988-842d-e09d68f8d163 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault megane e-tech hatchback ev60 160kw techno+ 60kwh optimum charge 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'megane e-tech hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 39330, 'odometer_reading_unit': 'mi', 'registration_date': '2024-04-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116611908', 'expiration_date': '2025-12-01t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'ev60 160kw techno+ 60kwh optimum charge 5dr auto', 'license_plate': 'lt24tua', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '2e5cb8e6-51ea-5988-842d-e09d68f8d163', 'current_year_diff': 1, 'age_in_months': 19, 'make_model': 'renault megane e-tech hatchback', 'sanitized_make': 'renault', 'odometer_in_km': 63295} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 19,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-01t10:00:00z',
     'fuel_type': 'electric',
     'id': '2e5cb8e6-51ea-5988-842d-e09d68f8d163',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lt24tua',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116611908',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'renault',
     'make_model': 'renault megane e-tech hatchback',
     'model': 'megane e-tech hatchback',
     'odometer': 39330,
     'odometer_in_km': 63295,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-04-26',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault megane e-tech hatchback ev60 160kw techno+ 60kwh '
              'optimum charge 5dr auto',
     'transmission': 'automatic',
     'trim': 'ev60 160kw techno+ 60kwh optimum charge 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '2e5cb8e6-51ea-5988-842d-e09d68f8d163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT24TUA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116611908',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'MEGANE E-TECH HATCHBACK',
 'odometer': 39330,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-26',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT MEGANE E-TECH HATCHBACK EV60 160kW Techno+ 60kWh Optimum '
          'Charge 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EV60 160kW Techno+ 60kWh Optimum Charge 5dr Auto',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116611908%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Saving data for 116611908: {'auction_closing_time': 1764583200.0, 'created_time': 1763579107.915204, 'last_price_update_time': 1764270094.003002}
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116611908') HTTP/1.1" 204 0
2025-11-27 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ab34f37e-2ec6-5536-80fc-097ae5d40659 with identifier: 116931130
2025-11-27 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ab34f37e-2ec6-5536-80fc-097ae5d40659 with identifier: 116931130
2025-11-27 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ab34f37e-2ec6-5536-80fc-097ae5d40659 with identifier: 116931130 to the API
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ab34f37e-2ec6-5536-80fc-097ae5d40659%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ab34f37e-2ec6-5536-80fc-097ae5d40659: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116931130?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ab34f37e-2ec6-5536-80fc-097ae5d40659',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN22AYE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116931130',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ESTATE',
 'odometer': 40696,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-30',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN TIGUAN ESTATE 2.0 TSI 4Motion Elegance 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TSI 4Motion Elegance 5dr DSG',
 'vin': None,
 'year': 2022}
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931130%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Saving data for 116931130: {'auction_closing_time': 1764583200.0, 'created_time': 1762283976.830996, 'last_price_update_time': 1764270094.327571}
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116931130') HTTP/1.1" 204 0
2025-11-27 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116672171?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117079893?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117570688
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570688%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117570688: 1
2025-11-27 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117570049
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570049%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117570049: 1
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117568753
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117568753: 1
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117570326
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570326%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117570326: 1
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117570740
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570740%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117570740: 1
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117570719
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570719%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117570719: 1
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116672171, 'registration': 'LS24HWA', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'YARIS CROSS ESTATE', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 18672, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2761, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-01', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LS24HWA/2025-10-28/image/6999bbd1-a9e6-4c5a-9a22-ec5d976eb535_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/eed71d59-193f-42fe-bc80-1c54c667c78c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/d2f3c2bf-48b8-4cc2-b1d6-c4fb6bc90824_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/209ed20a-7047-4b13-9742-d4cc02e8d2b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/1e894eb5-9826-4da4-804c-d2c41d90f307_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/ab9cafb4-0ea7-4b12-b961-25fcaf890a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/dd91f697-8e25-493c-b1e8-591f3e73b917_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/8fdba79a-34be-42c7-a1b7-ed27a461c2b3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/25 9K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aac0f7ff-3bfa-4023-9cee-770564709e6a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116672171, 'registration': 'LS24HWA', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'YARIS CROSS ESTATE', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 18672, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2761, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-01', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LS24HWA/2025-10-28/image/6999bbd1-a9e6-4c5a-9a22-ec5d976eb535_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/eed71d59-193f-42fe-bc80-1c54c667c78c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/d2f3c2bf-48b8-4cc2-b1d6-c4fb6bc90824_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/209ed20a-7047-4b13-9742-d4cc02e8d2b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/1e894eb5-9826-4da4-804c-d2c41d90f307_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/ab9cafb4-0ea7-4b12-b961-25fcaf890a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/dd91f697-8e25-493c-b1e8-591f3e73b917_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS24HWA/2025-10-28/image/8fdba79a-34be-42c7-a1b7-ed27a461c2b3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/25 9K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aac0f7ff-3bfa-4023-9cee-770564709e6a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4109109-bc38-5558-829b-20df4b0a6d43 with identifier: 116672171
2025-11-27 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4109109-bc38-5558-829b-20df4b0a6d43 with scrape type 2
2025-11-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4109109-bc38-5558-829b-20df4b0a6d43 with scrape type 2
2025-11-27 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b4109109-bc38-5558-829b-20df4b0a6d43, identifier: 116672171
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117079893, 'registration': 'OU24UJF', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'S-CROSS HATCHBACK', 'derivative': '1.4 Boosterjet 48V Hybrid Motion 5dr', 'mileage': 33506, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2775, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-05-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1373, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OU24UJF/2025-11-26/image/fc726e37-65e5-4403-b9d1-30b53edb744a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/d7be5517-4477-4766-92e2-00508715ca4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/607009c0-be83-49b0-87c0-bc81ebb3f5e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/0e874754-ee83-483a-8bad-7288217afe7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/b1965a3e-b8f7-4921-8114-ebce3c7cf986_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/767c99a5-19c0-4b78-bbee-93c90b18fa9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/a99c69a0-9e51-44f0-bf39-5b3a4bdfe624_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/5fe1b31b-19b6-4d6f-86bd-e35e4f138737_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/827416ec-e30c-4a12-8ad8-01004d6c4ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/fd8dbf8a-70e1-4bb5-bb61-974e673d3fd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 15K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65c1e21c-2606-41aa-9bdc-4ed24d302e40.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117079893, 'registration': 'OU24UJF', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'S-CROSS HATCHBACK', 'derivative': '1.4 Boosterjet 48V Hybrid Motion 5dr', 'mileage': 33506, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2775, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-05-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1373, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OU24UJF/2025-11-26/image/fc726e37-65e5-4403-b9d1-30b53edb744a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/d7be5517-4477-4766-92e2-00508715ca4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/607009c0-be83-49b0-87c0-bc81ebb3f5e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/0e874754-ee83-483a-8bad-7288217afe7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/b1965a3e-b8f7-4921-8114-ebce3c7cf986_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/767c99a5-19c0-4b78-bbee-93c90b18fa9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/a99c69a0-9e51-44f0-bf39-5b3a4bdfe624_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/5fe1b31b-19b6-4d6f-86bd-e35e4f138737_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/827416ec-e30c-4a12-8ad8-01004d6c4ace_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU24UJF/2025-11-26/image/fd8dbf8a-70e1-4bb5-bb61-974e673d3fd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 15K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65c1e21c-2606-41aa-9bdc-4ed24d302e40.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0076f8db-471e-55f8-9dd6-49283a89745c with identifier: 117079893
2025-11-27 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0076f8db-471e-55f8-9dd6-49283a89745c with scrape type 2
2025-11-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0076f8db-471e-55f8-9dd6-49283a89745c with scrape type 2
2025-11-27 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0076f8db-471e-55f8-9dd6-49283a89745c, identifier: 117079893
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 116720970
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116720970%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 116720970: 0
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117421533
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421533%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117421533: 0
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117456785
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117456785%27 HTTP/1.1" 200 None
2025-11-27 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117456785: 1
2025-11-27 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b4109109-bc38-5558-829b-20df4b0a6d43 with identifier: 116672171
2025-11-27 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b4109109-bc38-5558-829b-20df4b0a6d43 with identifier: 116672171
2025-11-27 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b4109109-bc38-5558-829b-20df4b0a6d43 with identifier: 116672171 to the API
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116672171?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'b4109109-bc38-5558-829b-20df4b0a6d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS24HWA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116672171',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'YARIS CROSS ESTATE',
 'odometer': 18672,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-01',
 'seller_name': 'Motability Operations',
 'title': 'TOYOTA YARIS CROSS ESTATE 1.5 Hybrid Icon 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid Icon 5dr CVT',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116672171%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Saving data for 116672171: {'auction_closing_time': 1764583200.0, 'created_time': 1763579064.824122, 'last_price_update_time': 1764270095.035994}
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116672171') HTTP/1.1" 204 0
2025-11-27 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0076f8db-471e-55f8-9dd6-49283a89745c with identifier: 117079893
2025-11-27 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0076f8db-471e-55f8-9dd6-49283a89745c with identifier: 117079893
2025-11-27 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0076f8db-471e-55f8-9dd6-49283a89745c with identifier: 117079893 to the API
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117079893?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0076f8db-471e-55f8-9dd6-49283a89745c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OU24UJF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117079893',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SUZUKI',
 'model': 'S-CROSS HATCHBACK',
 'odometer': 33506,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-28',
 'seller_name': 'Motability Operations',
 'title': 'SUZUKI S-CROSS HATCHBACK 1.4 Boosterjet 48V Hybrid Motion 5dr',
 'transmission': 'manual',
 'trim': '1.4 Boosterjet 48V Hybrid Motion 5dr',
 'vin': None,
 'year': 2024}
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079893%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Saving data for 117079893: {'auction_closing_time': 1764583200.0, 'created_time': 1763579027.690342, 'last_price_update_time': 1764270095.314312}
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117079893') HTTP/1.1" 204 0
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117178674
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178674%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117178674: 0
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 116857256
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116857256%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 116857256: 2
2025-11-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 116928625
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928625%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 116928625: 0
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 116928605
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928605%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 116928605: 0
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 116884491
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884491%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 116884491: 2
2025-11-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117022539
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117022539: 2
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 116321191
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116321191%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 116321191: 0
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117073655
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073655%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117073655: 0
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117023522
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117023522: 2
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117540120, 'registration': 'GY17CNK', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 SE Tech 5dr Auto', 'mileage': 129273, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1204, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/18-12K 11/18-20K 10/19-63K 12/20-82K 10/23-120K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 106K 115K 124K 127K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c94c33d8-6906-49bd-b003-11efb86d366c.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117540120, 'registration': 'GY17CNK', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 SE Tech 5dr Auto', 'mileage': 129273, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1204, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/18-12K 11/18-20K 10/19-63K 12/20-82K 10/23-120K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 106K 115K 124K 127K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c94c33d8-6906-49bd-b003-11efb86d366c.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 628e0c70-d61b-5045-bdcf-a4db2791dc5c with identifier: 117540120
2025-11-27 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c with scrape type 1
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 116994676
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 116994676: 2
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fa2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116937928, 'registration': 'NL68MVS', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d AMG Line Executive 5dr Auto', 'mileage': 49548, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL68MVS/2025-11-05/image/6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/ea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/f1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/c0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0985b39d-3bc3-40b1-af93-617f446296c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116937928, 'registration': 'NL68MVS', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d AMG Line Executive 5dr Auto', 'mileage': 49548, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL68MVS/2025-11-05/image/6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/ea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/f1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/c0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0985b39d-3bc3-40b1-af93-617f446296c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ba71b6-6590-54ae-a30f-a26ea81b9533 with identifier: 116937928
2025-11-27 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ba71b6-6590-54ae-a30f-a26ea81b9533 with scrape type 1
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116894508, 'registration': 'GF17HHA', 'account': 'MAN027', 'make': 'BMW', 'model': 'X6 DIESEL ESTATE', 'derivative': 'xDrive M50d 5dr Auto', 'mileage': 79981, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GF17HHA/2025-11-03/image/8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/e53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/fcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/d3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/ef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/f7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/bea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/a40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPRS UNKNOWN VOSA STATES 26K, 58K, 61K, 77K SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/798f1626-9000-40ea-b5fe-25c759d8fd72.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116894508, 'registration': 'GF17HHA', 'account': 'MAN027', 'make': 'BMW', 'model': 'X6 DIESEL ESTATE', 'derivative': 'xDrive M50d 5dr Auto', 'mileage': 79981, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-27', 'fuel': 'Diesel', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GF17HHA/2025-11-03/image/8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/e53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/fcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/d3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/ef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/f7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/bea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/a40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPRS UNKNOWN VOSA STATES 26K, 58K, 61K, 77K SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/798f1626-9000-40ea-b5fe-25c759d8fd72.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19ec35d1-1879-5eba-be8a-db9c6a19989b with identifier: 116894508
2025-11-27 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ec35d1-1879-5eba-be8a-db9c6a19989b with scrape type 1
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252F8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116988307, 'registration': 'WM21ZBZ', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250e AMG Line 5dr Auto', 'mileage': 108793, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/c198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/e1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/fdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/ae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print SERVICES RECORDED IN MILES AND KM -01/23 32K - 05/24 82KM', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 82K, 106K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 24, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16455155-bc8c-403f-a6d6-c232f1ab78ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116988307, 'registration': 'WM21ZBZ', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250e AMG Line 5dr Auto', 'mileage': 108793, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/c198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/e1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/fdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/ae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print SERVICES RECORDED IN MILES AND KM -01/23 32K - 05/24 82KM', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 82K, 106K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 24, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16455155-bc8c-403f-a6d6-c232f1ab78ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bf6ac4-f348-5706-8fe9-40b48433019d with identifier: 116988307
2025-11-27 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41bf6ac4-f348-5706-8fe9-40b48433019d with scrape type 1
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117012889, 'registration': 'X88SGD', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 86534, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-01-22', 'fuel': 'Diesel', 'motExpiry': '2025-12-18', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/X88SGD/2025-11-07/image/8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/ca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/f1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/996c9c3b-430d-409e-8222-d279d2438832.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117012889, 'registration': 'X88SGD', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 86534, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-01-22', 'fuel': 'Diesel', 'motExpiry': '2025-12-18', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/X88SGD/2025-11-07/image/8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/ca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/f1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg?w=600', 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/996c9c3b-430d-409e-8222-d279d2438832.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d with identifier: 117012889
2025-11-27 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d with scrape type 1
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117516097, 'registration': 'DA17JVP', 'account': 'WBA004', 'make': 'AUDI', 'model': 'Q3 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [184] Quattro Black Edition 5dr S Tronic', 'mileage': 69777, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1203, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-30', 'fuel': 'Diesel', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/19- 18K, 06/20- 28K, 03/21- 33K, 04/23- 45K, 01/25- 63K', 'remarks': 'MILEAGE DISCREPANCY VOSA STATES 05/20- UNKNOWN MILEAGE - 28K - 31K - 37,582 MILES (PASS) - 46,628 MILES (FAIL) - 43,316 MILES (PASS) - 51K - 62K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1b6806e3-161a-4d8a-9a15-2a5b41f6950a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117516097, 'registration': 'DA17JVP', 'account': 'WBA004', 'make': 'AUDI', 'model': 'Q3 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [184] Quattro Black Edition 5dr S Tronic', 'mileage': 69777, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1203, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-30', 'fuel': 'Diesel', 'motExpiry': '2025-11-28', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/19- 18K, 06/20- 28K, 03/21- 33K, 04/23- 45K, 01/25- 63K', 'remarks': 'MILEAGE DISCREPANCY VOSA STATES 05/20- UNKNOWN MILEAGE - 28K - 31K - 37,582 MILES (PASS) - 46,628 MILES (FAIL) - 43,316 MILES (PASS) - 51K - 62K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Trade', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1b6806e3-161a-4d8a-9a15-2a5b41f6950a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097
2025-11-27 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b28762c-2bae-5102-9653-180e962825f3 with scrape type 1
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117121221
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121221%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117121221: 2
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fde97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/ea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fe53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/e53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117189741
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189741%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117189741: 2
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fb08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Ffcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/fcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Fc198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/c198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252Fefc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117049073
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049073%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117049073: 2
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Ffaef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fd3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/d3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Fe1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/e1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117459212
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459212%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117459212: 0
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117267405
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267405%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117267405: 0
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117405024
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405024%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117405024: 2
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Ffde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/ef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252Fca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/ca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117405538
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405538%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117405538: 2
2025-11-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fb9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Ff7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/f7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117269087
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269087%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117269087: 0
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117272082
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272082%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117272082: 0
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117270372
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270372%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117270372: 0
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117493107
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493107%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117493107: 0
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117505465
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505465%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117505465: 2
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Ff1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/f1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252F9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117498449
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498449%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117498449: 2
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117543969, 'registration': 'OE17BCV', 'account': 'WBA003', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C220d AMG Line 4dr 9G-Tronic', 'mileage': 73683, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1226, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-16', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/e1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/a820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/f69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/18-4K 05/19-9K 05/20-17K 05/21-19K 05/22-25K 11/22-34K', 'remarks': 'SPARE KEY IN OFFICE, SD CARD IN OFFICE, VOSA STATES 22K 37K 51K 65K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/242b363b-2dee-491b-9151-ebc869100b54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117543969, 'registration': 'OE17BCV', 'account': 'WBA003', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C220d AMG Line 4dr 9G-Tronic', 'mileage': 73683, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1226, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-16', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/e1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/a820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/f69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/18-4K 05/19-9K 05/20-17K 05/21-19K 05/22-25K 11/22-34K', 'remarks': 'SPARE KEY IN OFFICE, SD CARD IN OFFICE, VOSA STATES 22K 37K 51K 65K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/242b363b-2dee-491b-9151-ebc869100b54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 with identifier: 117543969
2025-11-27 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 with scrape type 1
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fc12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fc7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fbea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/bea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Ffdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/fdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252Ff1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/f1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117425377?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117505618
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505618%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117505618: 2
2025-11-27 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fe1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/e1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452123?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fc0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/c0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252F1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Fae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/ae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117515973
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515973%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117515973: 0
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117023546
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117023546: 2
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117498571?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117420560?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117311708?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fec6cd0>
2025-11-27 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fa40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/a40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117425501?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117498483
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498483%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117498483: 0
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 116651075
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116651075%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 116651075: 0
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117273884
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273884%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117273884: 0
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 114036273
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114036273%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 114036273: 0
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117538915
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117538915%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117538915: 0
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117403384
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403384%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117403384: 2
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117425377, 'registration': 'WT18WFL', 'account': 'KCS003', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr', 'mileage': 113744, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WT18WFL/2025-11-24/image/49151907-3d7c-4695-a858-c7c0a4d4a9b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/d53692d0-6cd3-4424-8827-c0c3fc20f818_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/4e102daf-d505-4a87-bd01-5bda607d6178_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/b1f4d46b-592e-4f64-b51a-55968ee0af9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/e2df6981-5f36-4ecd-802d-3fa07b020c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/3638aacb-10c7-4835-ba42-7b95e84d8c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/8c18838c-480a-4d09-8f80-6880afa7654f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/979ab6d2-af97-4127-b8c3-caae4af88ed0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 04/18 13K - 11/19 28K - 09/20 33K - 08/21 46K - 04/22 58K - 02/23 70K - 12/23 85K - 07/24 97K - 06/25 110K', 'remarks': 'VOSA STATES 62K- 79K - 97K - 110K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba3d3176-b5c1-4edd-9a63-655c9ba278a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117425377, 'registration': 'WT18WFL', 'account': 'KCS003', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr', 'mileage': 113744, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WT18WFL/2025-11-24/image/49151907-3d7c-4695-a858-c7c0a4d4a9b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/d53692d0-6cd3-4424-8827-c0c3fc20f818_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/4e102daf-d505-4a87-bd01-5bda607d6178_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/b1f4d46b-592e-4f64-b51a-55968ee0af9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/e2df6981-5f36-4ecd-802d-3fa07b020c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/3638aacb-10c7-4835-ba42-7b95e84d8c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/8c18838c-480a-4d09-8f80-6880afa7654f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/979ab6d2-af97-4127-b8c3-caae4af88ed0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 04/18 13K - 11/19 28K - 09/20 33K - 08/21 46K - 04/22 58K - 02/23 70K - 12/23 85K - 07/24 97K - 06/25 110K', 'remarks': 'VOSA STATES 62K- 79K - 97K - 110K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba3d3176-b5c1-4edd-9a63-655c9ba278a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-11-27 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec51caee-5658-548b-b162-28ba8f6303d3 with scrape type 2
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec51caee-5658-548b-b162-28ba8f6303d3 with scrape type 2
2025-11-27 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec51caee-5658-548b-b162-28ba8f6303d3, identifier: 117425377
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117447787, 'registration': 'GP65ESU', 'account': 'THE109', 'make': 'KIA', 'model': 'RIO HATCHBACK SPECIAL EDITIONS', 'derivative': '1.25 SR7 5dr', 'mileage': 77629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2015-12-12', 'fuel': 'Petrol', 'motExpiry': '2025-12-11', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GP65ESU/2025-11-27/image/cdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/d1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/16 10K - 12/17 21K - 12/18 33K - 12/19 41K - 12/20 45K - 12/21 48K-  12/22 52K - 03/24 62K', 'remarks': 'VOSA STATES 48K - 52K - 59K - 69K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/83bf2c58-ceb9-4d39-a23a-d0131e5a71a4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117447787, 'registration': 'GP65ESU', 'account': 'THE109', 'make': 'KIA', 'model': 'RIO HATCHBACK SPECIAL EDITIONS', 'derivative': '1.25 SR7 5dr', 'mileage': 77629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2015-12-12', 'fuel': 'Petrol', 'motExpiry': '2025-12-11', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GP65ESU/2025-11-27/image/cdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/d1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 12/16 10K - 12/17 21K - 12/18 33K - 12/19 41K - 12/20 45K - 12/21 48K-  12/22 52K - 03/24 62K', 'remarks': 'VOSA STATES 48K - 52K - 59K - 69K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/83bf2c58-ceb9-4d39-a23a-d0131e5a71a4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5a28f6-1785-52f1-98c5-fd68ffc2b60e with identifier: 117447787
2025-11-27 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e with scrape type 1
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252Fcdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/cdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117452123, 'registration': 'KT66JVG', 'account': 'KCS003', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S 5dr Auto', 'mileage': 93324, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT66JVG/2025-11-24/image/165f1191-a254-4dae-b8f8-27bf001b2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/de93ae43-0f37-473d-8d2e-1d95243fc5a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/fa342ea5-162d-45e0-a4dc-82ba3a0a3f9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/f5ce7fcd-8984-4aa0-88d1-e2d6197622a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/8ef774d9-0134-4fb4-8adc-47197580ca5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/91f83bbe-5605-4598-82c0-e6b120b877fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/652a257d-d21c-443c-84da-b5d951368b6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/ca539604-6f2a-4c61-afef-6d79aac34944_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/5bc8f600-a33a-4789-9112-a7c4f6738f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/9b1f0fd4-4f4e-425b-b66e-c355e36146f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/3937eb23-267e-4439-b76a-908346275c68_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 11/18 12k - 12/19 25k - 11/20 33K', 'remarks': 'VOSA STATES 40K - 60K - 75K - 87K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/382399e9-e13f-490b-a3f9-7abe4fa442bd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117452123, 'registration': 'KT66JVG', 'account': 'KCS003', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S 5dr Auto', 'mileage': 93324, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT66JVG/2025-11-24/image/165f1191-a254-4dae-b8f8-27bf001b2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/de93ae43-0f37-473d-8d2e-1d95243fc5a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/fa342ea5-162d-45e0-a4dc-82ba3a0a3f9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/f5ce7fcd-8984-4aa0-88d1-e2d6197622a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/8ef774d9-0134-4fb4-8adc-47197580ca5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/91f83bbe-5605-4598-82c0-e6b120b877fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/652a257d-d21c-443c-84da-b5d951368b6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/ca539604-6f2a-4c61-afef-6d79aac34944_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/5bc8f600-a33a-4789-9112-a7c4f6738f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/9b1f0fd4-4f4e-425b-b66e-c355e36146f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/3937eb23-267e-4439-b76a-908346275c68_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 11/18 12k - 12/19 25k - 11/20 33K', 'remarks': 'VOSA STATES 40K - 60K - 75K - 87K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/382399e9-e13f-490b-a3f9-7abe4fa442bd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-11-27 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with scrape type 2
2025-11-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with scrape type 2
2025-11-27 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b, identifier: 117452123
2025-11-27 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-11-27 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-11-27 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183052
2025-11-27 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec51caee-5658-548b-b162-28ba8f6303d3 spider: astonbarclay.gb
2025-11-27 19:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ec51caee-5658-548b-b162-28ba8f6303d3 due to rule: high_mileage_for_country.json, error: 183052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183052
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ec51caee-5658-548b-b162-28ba8f6303d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WT18WFL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117425377',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER DIESEL ESTATE',
 'odometer': 113744,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': 'CarBuy Limited',
 'title': 'MITSUBISHI OUTLANDER DIESEL ESTATE 2.2 DI-D 4 5dr',
 'transmission': 'manual',
 'trim': '2.2 DI-D 4 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Saving data for 117425377: {'auction_closing_time': 1764331200.0, 'created_time': 1763751630.089459, 'last_price_update_time': 1764270098.196048}
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117425377') HTTP/1.1" 204 0
2025-11-27 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-11-27 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-11-27 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150190 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150190
2025-11-27 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b spider: astonbarclay.gb
2025-11-27 19:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b due to rule: high_mileage_for_country.json, error: 150190 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150190
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '20ab3011-b9cc-544b-bd87-9a940ebbfe5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KT66JVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452123',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 93324,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': 'CarBuy Limited',
 'title': 'MINI HATCHBACK 2.0 Cooper S 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Cooper S 5dr Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Saving data for 117452123: {'auction_closing_time': 1764331200.0, 'created_time': 1764010879.85748, 'last_price_update_time': 1764270098.494761}
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452123') HTTP/1.1" 204 0
2025-11-27 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/f1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117459654
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459654%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117459654: 0
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117030784
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030784%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117030784: 0
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117457838
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457838%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117457838: 0
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 115457692
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Scrape type for 115457692: 2
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fa820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/a820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117498571, 'registration': 'LP17MLJ', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi N-Tec 5dr [7 Seat]', 'mileage': 80674, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/8b6146d2-3f6e-46d4-b500-c38e19adc2a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/ee4363e3-2fbe-4137-8c17-b2533973175e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/1a29b6d0-e56d-43ba-90cf-e9f42368273c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/0f28e018-fdf3-4efe-bc9c-d1982cf0eaca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/b8727393-c3cd-42dc-8b7c-22e889728f4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/de8ebdb0-4a2a-4304-ae3d-4878826c02a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/91193e7b-06cc-4eb5-b67b-1876e4656ff9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/e20f6dd3-f220-44ac-aba7-a7b8d6a604e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/db06ba3e-5b3b-4d6e-9341-48df65ad2df0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/abec3e41-a80d-4e23-9515-a92e248175b7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/19-11K 04/21-33K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 39K 52K 63K 71K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5cdd0c6-205c-442c-85ee-1c7dfa692dc8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117498571, 'registration': 'LP17MLJ', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi N-Tec 5dr [7 Seat]', 'mileage': 80674, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-29', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/8b6146d2-3f6e-46d4-b500-c38e19adc2a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/ee4363e3-2fbe-4137-8c17-b2533973175e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/1a29b6d0-e56d-43ba-90cf-e9f42368273c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/0f28e018-fdf3-4efe-bc9c-d1982cf0eaca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/b8727393-c3cd-42dc-8b7c-22e889728f4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/de8ebdb0-4a2a-4304-ae3d-4878826c02a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/91193e7b-06cc-4eb5-b67b-1876e4656ff9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/e20f6dd3-f220-44ac-aba7-a7b8d6a604e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/db06ba3e-5b3b-4d6e-9341-48df65ad2df0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP17MLJ/2025-11-26/image/abec3e41-a80d-4e23-9515-a92e248175b7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/19-11K 04/21-33K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 39K 52K 63K 71K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5cdd0c6-205c-442c-85ee-1c7dfa692dc8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4867edb5-0d90-577f-96bb-db0c6ec3dfbf with identifier: 117498571
2025-11-27 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4867edb5-0d90-577f-96bb-db0c6ec3dfbf with scrape type 2
2025-11-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4867edb5-0d90-577f-96bb-db0c6ec3dfbf with scrape type 2
2025-11-27 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4867edb5-0d90-577f-96bb-db0c6ec3dfbf, identifier: 117498571
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117420560, 'registration': 'FM65VFS', 'account': 'MAN037', 'make': 'HONDA', 'model': 'CR-V DIESEL ESTATE', 'derivative': '1.6 i-DTEC 160 EX 5dr', 'mileage': 98819, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-18', 'fuel': 'Diesel', 'motExpiry': '2025-12-14', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FM65VFS/2025-11-21/image/5b802a99-ed18-4cf5-8da1-6a9f8642331c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/631a986d-7f59-4336-b143-9f51512cd5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/2bc4222e-47b3-4aa0-b26c-b81c35aee130_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/e0b299e0-240c-462b-8539-2637dea2e917_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/8448a5eb-3548-4068-9c1c-bf45f85385eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/08146d1a-f86b-43e0-a7d5-19c9823e5ec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/4b929e83-3b34-44de-a6e1-7091de3f8d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/a5231eb4-dab2-4f56-bd36-4e804e1e7257_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 10/16 12K - 07/17 25K - 02/18 31K - 09/19 37K - 11/21 58K - 06/23 81K - 12/24 92K -', 'remarks': 'VOSA STATES 58K- 74K - 86K - 92K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c69df6d9-3bfb-4bc9-a98f-469f53f005eb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117420560, 'registration': 'FM65VFS', 'account': 'MAN037', 'make': 'HONDA', 'model': 'CR-V DIESEL ESTATE', 'derivative': '1.6 i-DTEC 160 EX 5dr', 'mileage': 98819, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-18', 'fuel': 'Diesel', 'motExpiry': '2025-12-14', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FM65VFS/2025-11-21/image/5b802a99-ed18-4cf5-8da1-6a9f8642331c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/631a986d-7f59-4336-b143-9f51512cd5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/2bc4222e-47b3-4aa0-b26c-b81c35aee130_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/e0b299e0-240c-462b-8539-2637dea2e917_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/8448a5eb-3548-4068-9c1c-bf45f85385eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/08146d1a-f86b-43e0-a7d5-19c9823e5ec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/4b929e83-3b34-44de-a6e1-7091de3f8d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/FM65VFS/2025-11-21/image/a5231eb4-dab2-4f56-bd36-4e804e1e7257_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 10/16 12K - 07/17 25K - 02/18 31K - 09/19 37K - 11/21 58K - 06/23 81K - 12/24 92K -', 'remarks': 'VOSA STATES 58K- 74K - 86K - 92K -', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c69df6d9-3bfb-4bc9-a98f-469f53f005eb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0 with identifier: 117420560
2025-11-27 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0 with scrape type 2
2025-11-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0 with scrape type 2
2025-11-27 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0, identifier: 117420560
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117311708, 'registration': 'LP69DMZ', 'account': 'MAN037', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO Match Edition 5dr', 'mileage': 93096, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-01-20', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/a6843e07-c65b-4401-98c2-5f2271061044_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/0ec9d7ca-606f-4e93-b123-a89237bf5897_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/5939a1fc-290f-44a5-a2a1-ecae5e89b94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/726b4923-419f-4f38-9155-f995c2259f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/d60cbfed-797e-4fcc-acee-e00ecdc60d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b9ca54e6-9f0f-4b3f-8847-213bf32e232c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b765dc8b-f8af-4847-ab12-9d441b98434e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/91dd433f-f5d1-4aa7-83d2-43ee144274ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 028/20 17K - 02/21 29K - 05/21 36K - 12/22 77K- 08/23 82K 08/24 86K 08/25 91K', 'remarks': 'VOSA STATES 77K- 83K- 87K - 92K SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86461ec9-65eb-4cc8-9d9a-43dc6990f4fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117311708, 'registration': 'LP69DMZ', 'account': 'MAN037', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO Match Edition 5dr', 'mileage': 93096, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-01-20', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/a6843e07-c65b-4401-98c2-5f2271061044_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/0ec9d7ca-606f-4e93-b123-a89237bf5897_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/5939a1fc-290f-44a5-a2a1-ecae5e89b94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/726b4923-419f-4f38-9155-f995c2259f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/d60cbfed-797e-4fcc-acee-e00ecdc60d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b9ca54e6-9f0f-4b3f-8847-213bf32e232c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b765dc8b-f8af-4847-ab12-9d441b98434e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/91dd433f-f5d1-4aa7-83d2-43ee144274ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 028/20 17K - 02/21 29K - 05/21 36K - 12/22 77K- 08/23 82K 08/24 86K 08/25 91K', 'remarks': 'VOSA STATES 77K- 83K- 87K - 92K SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86461ec9-65eb-4cc8-9d9a-43dc6990f4fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-11-27 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350707ad-cc6c-53bb-87b0-159f6e20ee05 with scrape type 2
2025-11-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 350707ad-cc6c-53bb-87b0-159f6e20ee05 with scrape type 2
2025-11-27 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 350707ad-cc6c-53bb-87b0-159f6e20ee05, identifier: 117311708
2025-11-27 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117569819?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4867edb5-0d90-577f-96bb-db0c6ec3dfbf with identifier: 117498571
2025-11-27 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4867edb5-0d90-577f-96bb-db0c6ec3dfbf with identifier: 117498571
2025-11-27 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4867edb5-0d90-577f-96bb-db0c6ec3dfbf with identifier: 117498571 to the API
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274867edb5-0d90-577f-96bb-db0c6ec3dfbf%27 HTTP/1.1" 200 None
2025-11-27 19:01:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4867edb5-0d90-577f-96bb-db0c6ec3dfbf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117498571?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '4867edb5-0d90-577f-96bb-db0c6ec3dfbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP17MLJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117498571',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'X-TRAIL DIESEL STATION WAGON',
 'odometer': 80674,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': 'CarGiant',
 'title': 'NISSAN X-TRAIL DIESEL STATION WAGON 1.6 dCi N-Tec 5dr [7 Seat]',
 'transmission': 'manual',
 'trim': '1.6 dCi N-Tec 5dr [7 Seat]',
 'vin': None,
 'year': 2017}
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498571%27 HTTP/1.1" 200 None
2025-11-27 19:01:39 [astonbarclay.gb] INFO: Saving data for 117498571: {'auction_closing_time': 1764610200.0, 'created_time': 1764147674.591201, 'last_price_update_time': 1764270099.24043}
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117498571') HTTP/1.1" 204 0
2025-11-27 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0 with identifier: 117420560
2025-11-27 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0 with identifier: 117420560
2025-11-27 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159033 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159033
2025-11-27 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0 spider: astonbarclay.gb
2025-11-27 19:01:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0 due to rule: high_mileage_for_country.json, error: 159033 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159033
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd72495a2-72d0-5dfa-85e3-cc9fe5cb8dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FM65VFS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117420560',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V DIESEL ESTATE',
 'odometer': 98819,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-18',
 'seller_name': 'Manamanx Ltd',
 'title': 'HONDA CR-V DIESEL ESTATE 1.6 i-DTEC 160 EX 5dr',
 'transmission': 'manual',
 'trim': '1.6 i-DTEC 160 EX 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420560%27 HTTP/1.1" 200 None
2025-11-27 19:01:39 [astonbarclay.gb] INFO: Saving data for 117420560: {'auction_closing_time': 1764331200.0, 'created_time': 1763751909.661339, 'last_price_update_time': 1764270099.460857}
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117420560') HTTP/1.1" 204 0
2025-11-27 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-11-27 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-11-27 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708 to the API
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27350707ad-cc6c-53bb-87b0-159f6e20ee05%27 HTTP/1.1" 200 None
2025-11-27 19:01:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 350707ad-cc6c-53bb-87b0-159f6e20ee05: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117311708?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '350707ad-cc6c-53bb-87b0-159f6e20ee05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP69DMZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117311708',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 93096,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seller_name': 'Manamanx Ltd',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI EVO Match Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO Match Edition 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-11-27 19:01:39 [astonbarclay.gb] INFO: Saving data for 117311708: {'auction_closing_time': 1764331200.0, 'created_time': 1763492766.250229, 'last_price_update_time': 1764270099.768137}
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117311708') HTTP/1.1" 204 0
2025-11-27 19:01:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117425501, 'registration': 'LV65JXF', 'account': 'KCS003', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T Design 5dr', 'mileage': 118437, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2015-11-27', 'fuel': 'Petrol', 'motExpiry': '2025-12-10', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV65JXF/2025-11-24/image/dd047f9d-1bda-4b53-adea-6d7eaf017fbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/e5871826-4465-47f9-a187-a31944e2a41d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/22b0f805-5292-40f1-b7e8-eb5006e5a02b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/da4e0f95-c69d-4e35-b34f-4d6c64c6fa74_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/31618e01-2d22-409c-9a0b-6ce836462906_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/0962bad5-fc72-4430-abb3-585a6c542880_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/d32d886c-2dca-4b18-9ae2-c14e86a59e7a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 09/16 14K-  07/17 25K - 07/18 40K - 07/19 53K - 07/20 65K-  07/21 77K -', 'remarks': 'VOSA STATES 83K - 93K - 109K - 116K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33afe4ae-7347-42f6-914a-5a9f67261809.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117425501, 'registration': 'LV65JXF', 'account': 'KCS003', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T Design 5dr', 'mileage': 118437, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2015-11-27', 'fuel': 'Petrol', 'motExpiry': '2025-12-10', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV65JXF/2025-11-24/image/dd047f9d-1bda-4b53-adea-6d7eaf017fbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/e5871826-4465-47f9-a187-a31944e2a41d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/22b0f805-5292-40f1-b7e8-eb5006e5a02b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/da4e0f95-c69d-4e35-b34f-4d6c64c6fa74_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/31618e01-2d22-409c-9a0b-6ce836462906_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/0962bad5-fc72-4430-abb3-585a6c542880_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV65JXF/2025-11-24/image/d32d886c-2dca-4b18-9ae2-c14e86a59e7a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 09/16 14K-  07/17 25K - 07/18 40K - 07/19 53K - 07/20 65K-  07/21 77K -', 'remarks': 'VOSA STATES 83K - 93K - 109K - 116K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Limited', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33afe4ae-7347-42f6-914a-5a9f67261809.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a69428a1-d143-5994-a45f-3bbd52661501 with identifier: 117425501
2025-11-27 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a69428a1-d143-5994-a45f-3bbd52661501 with scrape type 2
2025-11-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a69428a1-d143-5994-a45f-3bbd52661501 with scrape type 2
2025-11-27 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a69428a1-d143-5994-a45f-3bbd52661501, identifier: 117425501
2025-11-27 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea32690>
2025-11-27 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fc12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/ae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117569895
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569895%27 HTTP/1.1" 200 None
2025-11-27 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117569895: 1
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a69428a1-d143-5994-a45f-3bbd52661501 with identifier: 117425501
2025-11-27 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a69428a1-d143-5994-a45f-3bbd52661501 with identifier: 117425501
2025-11-27 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190605 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190605
2025-11-27 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a69428a1-d143-5994-a45f-3bbd52661501 spider: astonbarclay.gb
2025-11-27 19:01:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a69428a1-d143-5994-a45f-3bbd52661501 due to rule: high_mileage_for_country.json, error: 190605 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190605
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a69428a1-d143-5994-a45f-3bbd52661501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV65JXF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117425501',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ZAFIRA TOURER',
 'odometer': 118437,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-27',
 'seller_name': 'CarBuy Limited',
 'title': 'VAUXHALL ZAFIRA TOURER 1.4T Design 5dr',
 'transmission': 'manual',
 'trim': '1.4T Design 5dr',
 'vin': None,
 'year': 2015}
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425501%27 HTTP/1.1" 200 None
2025-11-27 19:01:40 [astonbarclay.gb] INFO: Saving data for 117425501: {'auction_closing_time': 1764331200.0, 'created_time': 1763751947.793437, 'last_price_update_time': 1764270100.558484}
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117425501') HTTP/1.1" 204 0
2025-11-27 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452073?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb8be10>
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252Ff1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/f1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb89e90>
2025-11-27 19:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/cdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117135963
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-11-27 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117135963: 2
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117569819, 'registration': 'CP68LNV', 'account': 'KCS002', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG [7 Seat]', 'mileage': 106414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 76K - 94K - 101K - 106K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65964909-b959-4c1e-9a4b-e2653e98ffe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117569819, 'registration': 'CP68LNV', 'account': 'KCS002', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG [7 Seat]', 'mileage': 106414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 76K - 94K - 101K - 106K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65964909-b959-4c1e-9a4b-e2653e98ffe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-11-27 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with scrape type 1
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d
2025-11-27 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d, identifier: 117569819
2025-11-27 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-11-27 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-11-27 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171256 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171256
2025-11-27 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d spider: astonbarclay.gb
2025-11-27 19:01:41 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d due to rule: high_mileage_for_country.json, error: 171256 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171256
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CP68LNV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117569819',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KODIAQ ESTATE',
 'odometer': 106414,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seller_name': 'TCB Group - Prime',
 'title': 'SKODA KODIAQ ESTATE 1.5 TSI SE L 5dr DSG [7 Seat]',
 'transmission': 'automatic',
 'trim': '1.5 TSI SE L 5dr DSG [7 Seat]',
 'vin': None,
 'year': 2018}
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-11-27 19:01:41 [astonbarclay.gb] INFO: Saving data for 117569819: {'created_time': 1764270101.440459, 'last_price_update_time': 1764270101.440467, 'auction_closing_time': 1764610200.0}
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117569819') HTTP/1.1" 204 0
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feab250>
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea6fdd0>
2025-11-27 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec44550>
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Fae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/ae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec00bd0>
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/a40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/a820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117292139
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117292139%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117292139: 0
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117049908
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049908%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117049908: 0
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117271696
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271696%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117271696: 0
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117444266
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444266%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117444266: 0
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117188762
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188762%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117188762: 0
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117479608
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479608%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117479608: 0
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 116419349
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116419349%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Scrape type for 116419349: 2
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Ff69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/f69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117452073, 'registration': 'GN68VHD', 'account': 'MAN037', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Edition 4dr', 'mileage': 94880, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 4, 'engineSize': 1595, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GN68VHD/2025-11-24/image/a0c70d17-dcd3-43fa-b5ba-838f6cdf4534_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/bf749f05-ff3b-4e52-ac09-9f0c96318075_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/dfae070b-4cb2-4d2f-b105-a21d6f89d43e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9b5dab11-7797-4a62-b455-605db0718d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/1e022185-de54-494d-965b-89d76f8ef300_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/96946bc3-c9b8-47f9-be59-772107b7cb49_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/f5bd913c-503b-4e3a-8834-ef67b1f649d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9772f57a-7e5e-4f34-80c2-347e773147fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/ef194f53-1fa0-4d1c-86a7-e1fb2b6d97bb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 08/19- 16K, 08/20- 32K, 07/21- 51K, 05/22- 57K, 06/23- 64K', 'remarks': 'VOSA STATES 57K, 66K, 74K, 91K, SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37110487-b4b0-4823-8092-915a2f267dd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117452073, 'registration': 'GN68VHD', 'account': 'MAN037', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Edition 4dr', 'mileage': 94880, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 4, 'engineSize': 1595, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GN68VHD/2025-11-24/image/a0c70d17-dcd3-43fa-b5ba-838f6cdf4534_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/bf749f05-ff3b-4e52-ac09-9f0c96318075_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/dfae070b-4cb2-4d2f-b105-a21d6f89d43e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9b5dab11-7797-4a62-b455-605db0718d68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/1e022185-de54-494d-965b-89d76f8ef300_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/96946bc3-c9b8-47f9-be59-772107b7cb49_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/f5bd913c-503b-4e3a-8834-ef67b1f649d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/9772f57a-7e5e-4f34-80c2-347e773147fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN68VHD/2025-11-24/image/ef194f53-1fa0-4d1c-86a7-e1fb2b6d97bb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 08/19- 16K, 08/20- 32K, 07/21- 51K, 05/22- 57K, 06/23- 64K', 'remarks': 'VOSA STATES 57K, 66K, 74K, 91K, SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/37110487-b4b0-4823-8092-915a2f267dd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca9e29b-c998-5155-b420-6f077fe12770 with identifier: 117452073
2025-11-27 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca9e29b-c998-5155-b420-6f077fe12770 with scrape type 2
2025-11-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca9e29b-c998-5155-b420-6f077fe12770 with scrape type 2
2025-11-27 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2ca9e29b-c998-5155-b420-6f077fe12770, identifier: 117452073
2025-11-27 19:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116857256?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2ca9e29b-c998-5155-b420-6f077fe12770 with identifier: 117452073
2025-11-27 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2ca9e29b-c998-5155-b420-6f077fe12770 with identifier: 117452073
2025-11-27 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152694 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152694
2025-11-27 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2ca9e29b-c998-5155-b420-6f077fe12770 spider: astonbarclay.gb
2025-11-27 19:01:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 2ca9e29b-c998-5155-b420-6f077fe12770 due to rule: high_mileage_for_country.json, error: 152694 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152694
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2ca9e29b-c998-5155-b420-6f077fe12770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GN68VHD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452073',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 94880,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'Manamanx Ltd',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 180 AMG Line Edition 4dr',
 'transmission': 'manual',
 'trim': 'CLA 180 AMG Line Edition 4dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452073%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Saving data for 117452073: {'auction_closing_time': 1764331200.0, 'created_time': 1764010884.333554, 'last_price_update_time': 1764270103.134541}
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452073') HTTP/1.1" 204 0
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe0bf90>
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252Fcdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/cdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0f1710>
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 117432748
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117432748%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Scrape type for 117432748: 0
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 116706380
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116706380%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Scrape type for 116706380: 0
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 117419626
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419626%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Scrape type for 117419626: 0
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 117426828
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426828%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Scrape type for 117426828: 0
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 117527309
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117527309%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Scrape type for 117527309: 0
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 116800442
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116800442%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [astonbarclay.gb] INFO: Scrape type for 116800442: 2
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fc0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee67d0>
2025-11-27 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fa40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/a40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea4b790>
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fa820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/a820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb86890>
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117456785, 'registration': 'HX17PZW', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line 4dr Tip Auto', 'mileage': 92286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-15', 'fuel': 'Petrol', 'motExpiry': '2025-02-28', 'doors': 4, 'engineSize': 1595, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HX17PZW/2025-11-27/image/92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/e436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/b96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/18 15K - 04/19 27K -', 'remarks': 'VOSA IN MILES KM AND MILES  VOSA STATES 62KM - 38K- 52K- 67K - 79K-', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43be7d25-abab-4811-826b-3a11a5362926.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117456785, 'registration': 'HX17PZW', 'account': 'THE109', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line 4dr Tip Auto', 'mileage': 92286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-15', 'fuel': 'Petrol', 'motExpiry': '2025-02-28', 'doors': 4, 'engineSize': 1595, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HX17PZW/2025-11-27/image/92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/e436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/b96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/18 15K - 04/19 27K -', 'remarks': 'VOSA IN MILES KM AND MILES  VOSA STATES 62KM - 38K- 52K- 67K - 79K-', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43be7d25-abab-4811-826b-3a11a5362926.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49b2ae45-9f00-56fa-9e88-bc407694c7b2 with identifier: 117456785
2025-11-27 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2 with scrape type 1
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 116988436
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988436%27 HTTP/1.1" 200 None
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Scrape type for 116988436: 0
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117494260
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117494260%27 HTTP/1.1" 200 None
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117494260: 0
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117238218
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238218%27 HTTP/1.1" 200 None
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117238218: 0
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117553753
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553753%27 HTTP/1.1" 200 None
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117553753: 1
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116857256, 'registration': 'WP19NHT', 'account': 'GAT001', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 59233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WP19NHT/2025-10-31/image/d2e93b06-b5c1-4ecb-8447-46dd9d0d776f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/25183bfe-ea46-49c3-86b7-be945682674e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/4b84c586-e327-4930-a241-a2e5dfe41775_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/82dffc1d-28d4-4a44-9a59-b560e5a0fed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/bbfb5aac-e64f-4da2-983a-511415dd5f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/401576f6-4acb-47ab-b95c-6a348fdaac57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/0cddd811-6201-4046-8d9c-e31e6e2227a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/74db46a9-9677-4f53-b01e-4f61e93772bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/c6adef3e-ac82-44f2-8f9a-4c6325c92d38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/dbf8afae-9f57-4268-9dd8-3e47909a8a15_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 12/20 17K', 'remarks': 'VOSA STATES 24K - 30K - 41K- 54K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/724a513a-37a8-4733-9002-648db9ecfd16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116857256, 'registration': 'WP19NHT', 'account': 'GAT001', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 59233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WP19NHT/2025-10-31/image/d2e93b06-b5c1-4ecb-8447-46dd9d0d776f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/25183bfe-ea46-49c3-86b7-be945682674e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/4b84c586-e327-4930-a241-a2e5dfe41775_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/82dffc1d-28d4-4a44-9a59-b560e5a0fed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/bbfb5aac-e64f-4da2-983a-511415dd5f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/401576f6-4acb-47ab-b95c-6a348fdaac57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/0cddd811-6201-4046-8d9c-e31e6e2227a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/74db46a9-9677-4f53-b01e-4f61e93772bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/c6adef3e-ac82-44f2-8f9a-4c6325c92d38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/dbf8afae-9f57-4268-9dd8-3e47909a8a15_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 12/20 17K', 'remarks': 'VOSA STATES 24K - 30K - 41K- 54K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/724a513a-37a8-4733-9002-648db9ecfd16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256
2025-11-27 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1559227b-0549-5d03-b2a8-7e94bba4bf0b with scrape type 2
2025-11-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1559227b-0549-5d03-b2a8-7e94bba4bf0b with scrape type 2
2025-11-27 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1559227b-0549-5d03-b2a8-7e94bba4bf0b, identifier: 116857256
2025-11-27 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256
2025-11-27 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256
2025-11-27 19:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256 to the API
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116857256?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1559227b-0549-5d03-b2a8-7e94bba4bf0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WP19NHT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116857256',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 59233,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'Gates Group',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116857256%27 HTTP/1.1" 200 None
2025-11-27 19:01:45 [astonbarclay.gb] INFO: Saving data for 116857256: {'auction_closing_time': 1764331200.0, 'created_time': 1762284369.213868, 'last_price_update_time': 1764270105.427717}
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116857256') HTTP/1.1" 204 0
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eace510>
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec96990>
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/f69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117507342
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507342%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117507342: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117457472
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457472%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117457472: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117101013
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101013%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117101013: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117459952
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459952%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117459952: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 115294363
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115294363%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 115294363: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117507922
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507922%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117507922: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 114998202
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114998202%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 114998202: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117490116
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117490116%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117490116: 1
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252Fd1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/d1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117498449?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570719, 'registration': 'AF66FHH', 'account': 'MAN037', 'make': 'KIA', 'model': 'OPTIMA SALOON', 'derivative': '2.0 GDi PHEV 4dr Auto', 'mileage': 36586, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-01', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/21 12K -', 'remarks': 'VOSA STATES 12K- 21K- 30K - 36K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89f30c0c-9ec7-4779-832f-05b85dfe1655.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570719, 'registration': 'AF66FHH', 'account': 'MAN037', 'make': 'KIA', 'model': 'OPTIMA SALOON', 'derivative': '2.0 GDi PHEV 4dr Auto', 'mileage': 36586, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-01', 'doors': 4, 'engineSize': 1999, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/21 12K -', 'remarks': 'VOSA STATES 12K- 21K- 30K - 36K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 37, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89f30c0c-9ec7-4779-832f-05b85dfe1655.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719
2025-11-27 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948320e5-e8e7-5700-ac0d-311450e5b351 with scrape type 1
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570326, 'registration': 'HG16BWB', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.2 Sting 3dr', 'mileage': 72450, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-11', 'fuel': 'Petrol', 'motExpiry': '2026-04-03', 'doors': 3, 'engineSize': 1229, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/c23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/a095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/17 11K - ?? 34K - 06/22 51K 12/22 55K', 'remarks': 'VOSA STATES 49K - 58K-  64K- 70K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3fbdee5-9e32-4737-bec4-6750977fbd36.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570326, 'registration': 'HG16BWB', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.2 Sting 3dr', 'mileage': 72450, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-05-11', 'fuel': 'Petrol', 'motExpiry': '2026-04-03', 'doors': 3, 'engineSize': 1229, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/c23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/a095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/17 11K - ?? 34K - 06/22 51K 12/22 55K', 'remarks': 'VOSA STATES 49K - 58K-  64K- 70K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3fbdee5-9e32-4737-bec4-6750977fbd36.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2475f9-755c-5bfc-a99a-39fc2a5593c7 with identifier: 117570326
2025-11-27 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7 with scrape type 1
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570740, 'registration': 'DY65CRJ', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 68756, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 02/17 6K- 03/18 12K- 02/19 17K- 01/20 22K- 01/21 25K- 01/22 38K- 07/23 46K-  02/24 54K -02/25 61K', 'remarks': 'VOSA STATES 38K- 46K- 54K- 61K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb34262d-48f9-46a5-addd-fbab36e32274.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570740, 'registration': 'DY65CRJ', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 68756, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-02-29', 'fuel': 'Diesel', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 02/17 6K- 03/18 12K- 02/19 17K- 01/20 22K- 01/21 25K- 01/22 38K- 07/23 46K-  02/24 54K -02/25 61K', 'remarks': 'VOSA STATES 38K- 46K- 54K- 61K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cb34262d-48f9-46a5-addd-fbab36e32274.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740
2025-11-27 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with scrape type 1
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117568753, 'registration': 'DS67TJV', 'account': 'MAN037', 'make': 'MAZDA', 'model': 'CX-3 DIESEL HATCHBACK', 'derivative': '1.5d Sport Nav 5dr', 'mileage': 65256, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-12-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K- 54K- 62K - 65K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97f2b055-c554-4e52-a866-b4d85df17c3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117568753, 'registration': 'DS67TJV', 'account': 'MAN037', 'make': 'MAZDA', 'model': 'CX-3 DIESEL HATCHBACK', 'derivative': '1.5d Sport Nav 5dr', 'mileage': 65256, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-12-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K- 54K- 62K - 65K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97f2b055-c554-4e52-a866-b4d85df17c3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-11-27 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with scrape type 1
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/c0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/e1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb509d0>
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea4ae50>
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 116455336
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116455336%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 116455336: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117459942
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459942%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117459942: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117488530
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488530%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117488530: 0
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117458368
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458368%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117458368: 1
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252Fbc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F002960af-458d-43ff-be43-0ad326595abe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecad950>
2025-11-27 19:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252F1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd93b10>
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece8350>
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Ff69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/f69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE17BCV/2025-11-27/image/95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543969?view=catalogue)
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117479539
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479539%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117479539: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117517588
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517588%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117517588: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117214325
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214325%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117214325: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117362235
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362235%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117362235: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117217311
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217311%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117217311: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117459032
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459032%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117459032: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117517999
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517999%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117517999: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117517795
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517795%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117517795: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117267875
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267875%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117267875: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117404805
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404805%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117404805: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117517475
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517475%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117517475: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117267865
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267865%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117267865: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117422005
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422005%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117422005: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117070544
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117070544%27 HTTP/1.1" 200 None
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117070544: 0
2025-11-27 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117267902
2025-11-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267902%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117267902: 0
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 116831329
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831329%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Scrape type for 116831329: 0
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 117073748
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073748%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117073748: 0
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 117496386
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117496386%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117496386: 0
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 117555734
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555734%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117555734: 1
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252Fe4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252Fd6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117498449, 'registration': 'EK17ZLY', 'account': 'CAR001', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 ST-Line X 5dr Auto', 'mileage': 58437, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/2e279672-45af-4634-b53e-7142a1e19835_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/a07d3972-d5b3-4fe6-9976-a024732c5951_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/7ce3b947-8613-4c04-9ee3-27e38a129340_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/d73b439a-0065-4888-a4e7-0312029f52dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/8475f7c1-51bc-40e3-8d4a-ece184f47cda_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/e8ed8e6b-3bd7-479c-b9b6-867089f77a65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/6f00cb2d-252e-4be1-b34f-2b0088637fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/bcb75aa7-0f03-4b68-806f-016ac02ce459_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/3202c2d3-aa05-4625-a9e6-97836e64d33b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/18-31K 10/22-46K 10/23-50K 04/25-57K', 'remarks': 'VOSA STATES 36K 44K 46K 50K 54K 58K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88b9a5f8-9dec-41f9-bf19-778acfca942e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117498449, 'registration': 'EK17ZLY', 'account': 'CAR001', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 ST-Line X 5dr Auto', 'mileage': 58437, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/2e279672-45af-4634-b53e-7142a1e19835_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/a07d3972-d5b3-4fe6-9976-a024732c5951_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/7ce3b947-8613-4c04-9ee3-27e38a129340_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/d73b439a-0065-4888-a4e7-0312029f52dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/8475f7c1-51bc-40e3-8d4a-ece184f47cda_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/e8ed8e6b-3bd7-479c-b9b6-867089f77a65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/6f00cb2d-252e-4be1-b34f-2b0088637fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/bcb75aa7-0f03-4b68-806f-016ac02ce459_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17ZLY/2025-11-26/image/3202c2d3-aa05-4625-a9e6-97836e64d33b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/18-31K 10/22-46K 10/23-50K 04/25-57K', 'remarks': 'VOSA STATES 36K 44K 46K 50K 54K 58K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88b9a5f8-9dec-41f9-bf19-778acfca942e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec8ecced-281f-5e20-958e-06987acb4b24 with identifier: 117498449
2025-11-27 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec8ecced-281f-5e20-958e-06987acb4b24 with scrape type 2
2025-11-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec8ecced-281f-5e20-958e-06987acb4b24 with scrape type 2
2025-11-27 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec8ecced-281f-5e20-958e-06987acb4b24, identifier: 117498449
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1f010>
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fc0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/c0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d075010>
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fe1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/e1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d146550>
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/fdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117023546?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115457692?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec8ecced-281f-5e20-958e-06987acb4b24 with identifier: 117498449
2025-11-27 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec8ecced-281f-5e20-958e-06987acb4b24 with identifier: 117498449
2025-11-27 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ec8ecced-281f-5e20-958e-06987acb4b24 with identifier: 117498449 to the API
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ec8ecced-281f-5e20-958e-06987acb4b24%27 HTTP/1.1" 200 None
2025-11-27 19:01:49 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ec8ecced-281f-5e20-958e-06987acb4b24: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:49 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117498449?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'ec8ecced-281f-5e20-958e-06987acb4b24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK17ZLY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117498449',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 58437,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-28',
 'seller_name': 'CarGiant',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 TDCi 180 ST-Line X 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 180 ST-Line X 5dr Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498449%27 HTTP/1.1" 200 None
2025-11-27 19:01:49 [astonbarclay.gb] INFO: Saving data for 117498449: {'auction_closing_time': 1764610200.0, 'created_time': 1764147674.302338, 'last_price_update_time': 1764270109.658404}
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117498449') HTTP/1.1" 204 0
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feecd10>
2025-11-27 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe5aad0>
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252Fc0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117553459
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553459%27 HTTP/1.1" 200 None
2025-11-27 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117553459: 1
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252Ff9423201-b388-438f-930c-2094f02e0c41_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117135963?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117403384?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117505618?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117569895?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116419349?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec03c50>
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb6c710>
2025-11-27 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea34090>
2025-11-27 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE17BCV%252F2025-11-27%252Fimage%252F95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE17BCV/2025-11-27/image/95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0
2025-11-27 19:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a31efff-a470-5229-8b2a-6a9e8f9aeda0, skipping ID generation
2025-11-27 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 with scrape type 1
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 from tracking dictionaries
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 sending to next pipeline
2025-11-27 19:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1a31efff-a470-5229-8b2a-6a9e8f9aeda0, identifier: 117543969
2025-11-27 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117433885
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433885%27 HTTP/1.1" 200 None
2025-11-27 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117433885: 2
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 with identifier: 117543969
2025-11-27 19:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 with identifier: 117543969
2025-11-27 19:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1a31efff-a470-5229-8b2a-6a9e8f9aeda0 with identifier: 117543969 to the API
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/OE17BCV/2025-11-27/image/95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '1a31efff-a470-5229-8b2a-6a9e8f9aeda0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OE17BCV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117543969',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL SALOON',
 'odometer': 73683,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35622,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c12f2274-77f3-421d-a1fd-9e14989d7e5b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40656,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/e1368a07-8386-45c4-8b96-92917c6a2c52_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37202,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/4b421785-21a5-4ea3-87ca-b34fda6e92e1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35711,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/66f5bfac-19e7-419f-a921-6181063c690f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49993,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/a820b846-ba84-46b7-97d1-b3d4fba9b184_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42879,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/7546a49c-4e26-4222-9a2b-4b6296d058d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59453,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/30f80b3a-2411-4fc0-ad6b-063881d4e670_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37950,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/f69d287b-5463-4e43-a314-6e323fea436f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41962,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/c0633ea3-e9d5-479c-b20e-2d714fb32f29_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a31efff-a470-5229-8b2a-6a9e8f9aeda0/1a31efff-a470-5229-8b2a-6a9e8f9aeda0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52083,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OE17BCV/2025-11-27/image/95680061-e9ca-4dc6-89af-0ccf1492d589_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-28',
 'seller_name': 'UKCGR - Select',
 'title': 'MERCEDES-BENZ C CLASS DIESEL SALOON C220d AMG Line 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C220d AMG Line 4dr 9G-Tronic',
 'vin': None,
 'year': 2017}
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543969%27 HTTP/1.1" 200 None
2025-11-27 19:01:52 [astonbarclay.gb] INFO: Saving data for 117543969: {'created_time': 1764270112.055588, 'last_price_update_time': 1764270112.055598, 'auction_closing_time': 1764610200.0}
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117543969') HTTP/1.1" 204 0
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e986990>
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Ffdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/fdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e995450>
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117023546, 'registration': 'DG21HWN', 'account': 'LPK001', 'make': 'SEAT', 'model': 'CUPRA LEON ESTATE SPECIAL EDITION', 'derivative': '1.4 eHybrid First Edition 5dr DSG', 'mileage': 64765, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-04-05', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d597466d-8aeb-404b-9934-4b0cfc9d332f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d02c463c-2398-44b4-89e9-c991dcf73531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/5e4ad193-fa91-492e-afd1-8a620a2e0352_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8713f9d6-d626-48e8-a19b-c32c824b8552_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/68ec5301-7f7a-4c40-872b-481348fd94ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/88eba719-c70d-4753-8d26-796fca600677_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/a6ff1d3e-3a66-4a5d-a452-772ea6a7fd83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/59d7ff2d-1f53-496c-9e27-be9d962863d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/0288890e-bb37-4d4f-977c-0678641ee100_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8e8cbfeb-fcaf-4df6-b6a9-2429d0c8c304_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/ff469265-fea9-446c-b18f-1750b482e395_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 60K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80682b1f-279f-4852-a39e-e03204e6326f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117023546, 'registration': 'DG21HWN', 'account': 'LPK001', 'make': 'SEAT', 'model': 'CUPRA LEON ESTATE SPECIAL EDITION', 'derivative': '1.4 eHybrid First Edition 5dr DSG', 'mileage': 64765, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-04-05', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d597466d-8aeb-404b-9934-4b0cfc9d332f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d02c463c-2398-44b4-89e9-c991dcf73531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/5e4ad193-fa91-492e-afd1-8a620a2e0352_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8713f9d6-d626-48e8-a19b-c32c824b8552_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/68ec5301-7f7a-4c40-872b-481348fd94ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/88eba719-c70d-4753-8d26-796fca600677_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/a6ff1d3e-3a66-4a5d-a452-772ea6a7fd83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/59d7ff2d-1f53-496c-9e27-be9d962863d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/0288890e-bb37-4d4f-977c-0678641ee100_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8e8cbfeb-fcaf-4df6-b6a9-2429d0c8c304_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/ff469265-fea9-446c-b18f-1750b482e395_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 60K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80682b1f-279f-4852-a39e-e03204e6326f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546
2025-11-27 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a880db-d936-518f-9f7b-3c299ca85e13 with scrape type 2
2025-11-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a880db-d936-518f-9f7b-3c299ca85e13 with scrape type 2
2025-11-27 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 08a880db-d936-518f-9f7b-3c299ca85e13, identifier: 117023546
2025-11-27 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 115457692, 'registration': 'GU11LLT', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE Dynamic 5dr Auto', 'mileage': 58856, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d9430313-a41a-4543-9e38-bb174b8d8c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3d6c4928-b0dd-41c5-a7d6-17da830727d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/afab8c24-aaba-47ee-a54d-3361df10d9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/8b2b895a-acae-4376-99c6-99c321587142_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d46f2c47-217e-44aa-b227-81261cfcd068_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3676b677-aad7-4bb2-bd41-cd462779a256_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/f9a7c435-439a-4052-a22e-a9f6f0bdd4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/84ead4fd-c425-4ac3-9f96-4083538f5e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3bd85656-5e16-4949-9800-c2c495b30acd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/22-15K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 24K, 28K, 53K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 75, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/301af9a9-f42c-416a-ba0f-e59c32faa699.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 115457692, 'registration': 'GU11LLT', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE Dynamic 5dr Auto', 'mileage': 58856, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-18', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d9430313-a41a-4543-9e38-bb174b8d8c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3d6c4928-b0dd-41c5-a7d6-17da830727d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/afab8c24-aaba-47ee-a54d-3361df10d9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/8b2b895a-acae-4376-99c6-99c321587142_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/d46f2c47-217e-44aa-b227-81261cfcd068_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3676b677-aad7-4bb2-bd41-cd462779a256_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/f9a7c435-439a-4052-a22e-a9f6f0bdd4bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/84ead4fd-c425-4ac3-9f96-4083538f5e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU11LLT/2025-09-12/image/3bd85656-5e16-4949-9800-c2c495b30acd_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 10/22-15K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 24K, 28K, 53K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 75, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/301af9a9-f42c-416a-ba0f-e59c32faa699.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-11-27 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c771c7-041e-5d53-ad17-7dea3f7e3abd with scrape type 2
2025-11-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18c771c7-041e-5d53-ad17-7dea3f7e3abd with scrape type 2
2025-11-27 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 18c771c7-041e-5d53-ad17-7dea3f7e3abd, identifier: 115457692
2025-11-27 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252Fe436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/e436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546
2025-11-27 19:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546
2025-11-27 19:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546 to the API
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2708a880db-d936-518f-9f7b-3c299ca85e13%27 HTTP/1.1" 200 None
2025-11-27 19:01:53 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 08a880db-d936-518f-9f7b-3c299ca85e13: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:52 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117023546?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '08a880db-d936-518f-9f7b-3c299ca85e13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DG21HWN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117023546',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'CUPRA LEON ESTATE SPECIAL EDITION',
 'odometer': 64765,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seller_name': 'Auction Plus',
 'title': 'SEAT CUPRA LEON ESTATE SPECIAL EDITION 1.4 eHybrid First Edition '
          '5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid First Edition 5dr DSG',
 'vin': None,
 'year': 2021}
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2025-11-27 19:01:53 [astonbarclay.gb] INFO: Saving data for 117023546: {'auction_closing_time': 1764331200.0, 'created_time': 1762844451.959818, 'last_price_update_time': 1764270113.171518}
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117023546') HTTP/1.1" 204 0
2025-11-27 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-11-27 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692
2025-11-27 19:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 18c771c7-041e-5d53-ad17-7dea3f7e3abd with identifier: 115457692 to the API
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115457692?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 75,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '18c771c7-041e-5d53-ad17-7dea3f7e3abd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GU11LLT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115457692',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT ESTATE',
 'odometer': 58856,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': 'Mann Island Finance',
 'title': 'LAND ROVER RANGE ROVER SPORT ESTATE 2.0 P400e HSE Dynamic 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 P400e HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2020}
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-11-27 19:01:53 [astonbarclay.gb] INFO: Saving data for 115457692: {'auction_closing_time': 1764331200.0, 'created_time': 1762283180.530747, 'last_price_update_time': 1764270113.486153}
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115457692') HTTP/1.1" 204 0
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e814c90>
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e823610>
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:01:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117135963, 'registration': 'LX66LNR', 'account': 'SID006', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '1.0 TFSI Sport 5dr', 'mileage': 84576, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-03', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66LNR/2025-11-25/image/b58b5dd2-396f-4cb7-9ee8-b95e4927ec53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/7d60b44f-9967-419f-9f9b-747151379cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/342067ed-2e8e-4478-a326-e02279e5210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/661fc492-177e-4936-ac7f-04cadff40636_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/f3b2ffc4-21f0-408b-b879-3f4ae5804950_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/e3c52318-0382-443e-8ad2-f39cd51fb4aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/0594d9dd-5231-4c0c-afb0-314cfd8800de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/deaa8a75-ed42-431f-b09f-4b7d72a416b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a13df5df-8b41-4c53-81db-a0a2c0ee03dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/84c6abf6-02df-4c12-bb7c-035e917658b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a5135f13-e012-4237-ac2c-8b41733d5e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/4b87a4e9-2ee6-49d4-9d2f-024ebc038068_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 ONLY -VOSA STATES 45K, 55K, 61K, 82K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd44ffd5-2a16-4a54-84fd-e8dd8d7b9bfb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117135963, 'registration': 'LX66LNR', 'account': 'SID006', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '1.0 TFSI Sport 5dr', 'mileage': 84576, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-03', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66LNR/2025-11-25/image/b58b5dd2-396f-4cb7-9ee8-b95e4927ec53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/7d60b44f-9967-419f-9f9b-747151379cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/342067ed-2e8e-4478-a326-e02279e5210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/661fc492-177e-4936-ac7f-04cadff40636_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/f3b2ffc4-21f0-408b-b879-3f4ae5804950_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/e3c52318-0382-443e-8ad2-f39cd51fb4aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/0594d9dd-5231-4c0c-afb0-314cfd8800de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/deaa8a75-ed42-431f-b09f-4b7d72a416b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a13df5df-8b41-4c53-81db-a0a2c0ee03dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/84c6abf6-02df-4c12-bb7c-035e917658b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a5135f13-e012-4237-ac2c-8b41733d5e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/4b87a4e9-2ee6-49d4-9d2f-024ebc038068_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 ONLY -VOSA STATES 45K, 55K, 61K, 82K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd44ffd5-2a16-4a54-84fd-e8dd8d7b9bfb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-11-27 19:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e186c8-37e8-5509-8502-2d44f8e4150f with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e186c8-37e8-5509-8502-2d44f8e4150f with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 45e186c8-37e8-5509-8502-2d44f8e4150f, identifier: 117135963
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117403384, 'registration': 'GV67PNN', 'account': 'THE109', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.0 2 5dr', 'mileage': 30726, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-02-09', 'fuel': 'Petrol', 'motExpiry': '2026-02-08', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GV67PNN/2025-11-26/image/1951e3be-e6e2-4309-b351-421d2a0c4a4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/46478e73-29d4-425a-a0ce-8446465d9e43_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/55329726-cb72-431e-b89b-134ba38dc88b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/fa565e31-239e-40c9-8c62-629587f77f50_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/b0ed5e8b-066b-4fb4-be68-c1fb043a68a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/8b85fc50-4c1b-4982-87a6-1624476a4117_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/7b029f3e-ff3d-4969-bd3d-eb4f1d618708_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/3093e130-b910-4121-b918-8cbdd6b523eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/a9ffc487-7d84-491d-8bb4-ddf8e7964c5f_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4e027581-63eb-43ba-890b-992a830bcd3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117403384, 'registration': 'GV67PNN', 'account': 'THE109', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.0 2 5dr', 'mileage': 30726, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-02-09', 'fuel': 'Petrol', 'motExpiry': '2026-02-08', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GV67PNN/2025-11-26/image/1951e3be-e6e2-4309-b351-421d2a0c4a4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/46478e73-29d4-425a-a0ce-8446465d9e43_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/55329726-cb72-431e-b89b-134ba38dc88b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/fa565e31-239e-40c9-8c62-629587f77f50_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/b0ed5e8b-066b-4fb4-be68-c1fb043a68a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/8b85fc50-4c1b-4982-87a6-1624476a4117_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/7b029f3e-ff3d-4969-bd3d-eb4f1d618708_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/3093e130-b910-4121-b918-8cbdd6b523eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV67PNN/2025-11-26/image/a9ffc487-7d84-491d-8bb4-ddf8e7964c5f_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4e027581-63eb-43ba-890b-992a830bcd3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29125018-0495-55b8-a379-4fec750fb855 with identifier: 117403384
2025-11-27 19:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29125018-0495-55b8-a379-4fec750fb855 with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29125018-0495-55b8-a379-4fec750fb855 with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 29125018-0495-55b8-a379-4fec750fb855, identifier: 117403384
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117505618, 'registration': 'BP18PNF', 'account': 'MAN037', 'make': 'FIAT', 'model': '124 SPIDER CONVERTIBLE SPECIAL EDITIONS', 'derivative': '1.4 Multiair S-Design 2dr', 'mileage': 56569, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 2, 'engineSize': 1368, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/BP18PNF/2025-11-26/image/f72746a4-810b-4e12-b0e8-e3781b7ecff5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/3a378f71-1f98-40a9-a702-2e21d28f111c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/e11e0c6f-2ea1-41ff-940d-b45d49e7ab33_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/7d931009-0bc7-4bce-8f26-09ef9ac9d9de_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/a2c84ce9-adab-4aec-87a6-d63bfa4b1e8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/86c72ec3-40d3-4c85-a4da-119c58b240b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/de447993-989b-40f4-b041-8df443a9f9be_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 05/19 9K - 11/19 18K - 10/20 27K - 06/21 35K - 05/23 45K - 06/24 47K', 'remarks': 'VOSA STATES, 40K, 45K, 47K, 53K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba795099-348b-4904-9f1f-2b5138002581.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117505618, 'registration': 'BP18PNF', 'account': 'MAN037', 'make': 'FIAT', 'model': '124 SPIDER CONVERTIBLE SPECIAL EDITIONS', 'derivative': '1.4 Multiair S-Design 2dr', 'mileage': 56569, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 2, 'engineSize': 1368, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/BP18PNF/2025-11-26/image/f72746a4-810b-4e12-b0e8-e3781b7ecff5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/3a378f71-1f98-40a9-a702-2e21d28f111c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/e11e0c6f-2ea1-41ff-940d-b45d49e7ab33_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/7d931009-0bc7-4bce-8f26-09ef9ac9d9de_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/a2c84ce9-adab-4aec-87a6-d63bfa4b1e8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/86c72ec3-40d3-4c85-a4da-119c58b240b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP18PNF/2025-11-26/image/de447993-989b-40f4-b041-8df443a9f9be_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 05/19 9K - 11/19 18K - 10/20 27K - 06/21 35K - 05/23 45K - 06/24 47K', 'remarks': 'VOSA STATES, 40K, 45K, 47K, 53K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba795099-348b-4904-9f1f-2b5138002581.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa95a9b4-5efa-587a-a6be-b0c30d9b72d4 with identifier: 117505618
2025-11-27 19:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa95a9b4-5efa-587a-a6be-b0c30d9b72d4 with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa95a9b4-5efa-587a-a6be-b0c30d9b72d4 with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fa95a9b4-5efa-587a-a6be-b0c30d9b72d4, identifier: 117505618
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117569895, 'registration': 'FV16FTT', 'account': 'KCS002', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS ESTATE', 'derivative': 'C200 Sport Premium 5dr Auto', 'mileage': 56133, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-05-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-01', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9dc4dc9c-2f45-43dd-a670-c26172b07e5e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117569895, 'registration': 'FV16FTT', 'account': 'KCS002', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS ESTATE', 'derivative': 'C200 Sport Premium 5dr Auto', 'mileage': 56133, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-05-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-01', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9dc4dc9c-2f45-43dd-a670-c26172b07e5e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ed9350c-da9a-59f1-9219-725588cf631e with identifier: 117569895
2025-11-27 19:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ed9350c-da9a-59f1-9219-725588cf631e with scrape type 1
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9ed9350c-da9a-59f1-9219-725588cf631e
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9ed9350c-da9a-59f1-9219-725588cf631e
2025-11-27 19:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9ed9350c-da9a-59f1-9219-725588cf631e, identifier: 117569895
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116419349, 'registration': 'LT19ZUD', 'account': 'AST003', 'make': 'VAUXHALL', 'model': 'MOKKA X DIESEL HATCHBACK', 'derivative': '1.6CDTi [136] Elite 5dr 4WD', 'mileage': 75885, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a39f1560-0961-4b25-9dbb-e7c2995a4632_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/5271fb42-9454-4112-a9d9-4a4ad868880a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/06edee98-ca68-4117-a62f-fb2c4443b6e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/d3e086ae-3944-4b59-9eaf-6ad1e1186762_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/05ff7b38-433d-4bdc-8095-bba21fa8ed3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/9c3852cf-35ba-4bff-8840-4b832c5f3380_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/b029914d-4f05-4044-b579-45fe5a957053_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a54192b6-27bf-49e1-b3d2-990cfe96c35b_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/20-16K, 03/21-29K, 03/22-44K, 03/23-59K, 03/24-73K, 07/25-75K, - EXCESSIVE NOISE FROM UNDER CAR - SUSPECTED TRANSMISSION ISSUE: CODES U0136 & U0078', 'remarks': 'SPARE KEY, VOSA STATES 44K 59K 73K 74K', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0be3f5e8-8bcf-4e5c-8bed-daee96f2156a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116419349, 'registration': 'LT19ZUD', 'account': 'AST003', 'make': 'VAUXHALL', 'model': 'MOKKA X DIESEL HATCHBACK', 'derivative': '1.6CDTi [136] Elite 5dr 4WD', 'mileage': 75885, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a39f1560-0961-4b25-9dbb-e7c2995a4632_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/5271fb42-9454-4112-a9d9-4a4ad868880a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/06edee98-ca68-4117-a62f-fb2c4443b6e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/d3e086ae-3944-4b59-9eaf-6ad1e1186762_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/05ff7b38-433d-4bdc-8095-bba21fa8ed3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/9c3852cf-35ba-4bff-8840-4b832c5f3380_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/b029914d-4f05-4044-b579-45fe5a957053_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT19ZUD/2025-10-21/image/a54192b6-27bf-49e1-b3d2-990cfe96c35b_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/20-16K, 03/21-29K, 03/22-44K, 03/23-59K, 03/24-73K, 07/25-75K, - EXCESSIVE NOISE FROM UNDER CAR - SUSPECTED TRANSMISSION ISSUE: CODES U0136 & U0078', 'remarks': 'SPARE KEY, VOSA STATES 44K 59K 73K 74K', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0be3f5e8-8bcf-4e5c-8bed-daee96f2156a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349
2025-11-27 19:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d676fcba-aed3-5836-a442-e4f524f9a29d with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d676fcba-aed3-5836-a442-e4f524f9a29d with scrape type 2
2025-11-27 19:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d676fcba-aed3-5836-a442-e4f524f9a29d, identifier: 116419349
2025-11-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue)
2025-11-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117117971
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117117971%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117117971: 0
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117537050
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537050%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117537050: 0
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117323884
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117323884%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117323884: 2
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252Fbeedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252Fc23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/c23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252Fb9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-11-27 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-11-27 19:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963 to the API
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117135963?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '45e186c8-37e8-5509-8502-2d44f8e4150f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX66LNR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117135963',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 84576,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-03',
 'seller_name': 'Auction Plus',
 'title': 'AUDI A3 SPORTBACK 1.0 TFSI Sport 5dr',
 'transmission': 'manual',
 'trim': '1.0 TFSI Sport 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-11-27 19:01:54 [astonbarclay.gb] INFO: Saving data for 117135963: {'auction_closing_time': 1764331200.0, 'created_time': 1763060478.532667, 'last_price_update_time': 1764270114.898254}
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117135963') HTTP/1.1" 204 0
2025-11-27 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 29125018-0495-55b8-a379-4fec750fb855 with identifier: 117403384
2025-11-27 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-11-27 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 29125018-0495-55b8-a379-4fec750fb855 with identifier: 117403384
2025-11-27 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 29125018-0495-55b8-a379-4fec750fb855 with identifier: 117403384 to the API
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2729125018-0495-55b8-a379-4fec750fb855%27 HTTP/1.1" 200 None
2025-11-27 19:01:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 29125018-0495-55b8-a379-4fec750fb855: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117403384?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '29125018-0495-55b8-a379-4fec750fb855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GV67PNN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117403384',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'PICANTO HATCHBACK',
 'odometer': 30726,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-09',
 'seller_name': 'TCB Group - Prime',
 'title': 'KIA PICANTO HATCHBACK 1.0 2 5dr',
 'transmission': 'manual',
 'trim': '1.0 2 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403384%27 HTTP/1.1" 200 None
2025-11-27 19:01:55 [astonbarclay.gb] INFO: Saving data for 117403384: {'auction_closing_time': 1764610200.0, 'created_time': 1764147672.750959, 'last_price_update_time': 1764270115.360462}
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117403384') HTTP/1.1" 204 0
2025-11-27 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fa95a9b4-5efa-587a-a6be-b0c30d9b72d4 with identifier: 117505618
2025-11-27 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fa95a9b4-5efa-587a-a6be-b0c30d9b72d4 with identifier: 117505618
2025-11-27 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fa95a9b4-5efa-587a-a6be-b0c30d9b72d4 with identifier: 117505618 to the API
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fa95a9b4-5efa-587a-a6be-b0c30d9b72d4%27 HTTP/1.1" 200 None
2025-11-27 19:01:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fa95a9b4-5efa-587a-a6be-b0c30d9b72d4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:55 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117505618?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'fa95a9b4-5efa-587a-a6be-b0c30d9b72d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BP18PNF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505618',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '124 SPIDER CONVERTIBLE SPECIAL EDITIONS',
 'odometer': 56569,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'Manamanx Ltd',
 'title': 'FIAT 124 SPIDER CONVERTIBLE SPECIAL EDITIONS 1.4 Multiair S-Design '
          '2dr',
 'transmission': 'manual',
 'trim': '1.4 Multiair S-Design 2dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505618%27 HTTP/1.1" 200 None
2025-11-27 19:01:55 [astonbarclay.gb] INFO: Saving data for 117505618: {'auction_closing_time': 1764610200.0, 'created_time': 1764147673.994546, 'last_price_update_time': 1764270115.638764}
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117505618') HTTP/1.1" 204 0
2025-11-27 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9ed9350c-da9a-59f1-9219-725588cf631e with identifier: 117569895
2025-11-27 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9ed9350c-da9a-59f1-9219-725588cf631e with identifier: 117569895
2025-11-27 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9ed9350c-da9a-59f1-9219-725588cf631e with identifier: 117569895 to the API
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279ed9350c-da9a-59f1-9219-725588cf631e%27 HTTP/1.1" 200 None
2025-11-27 19:01:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9ed9350c-da9a-59f1-9219-725588cf631e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:01:55 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117569895?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '9ed9350c-da9a-59f1-9219-725588cf631e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FV16FTT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117569895',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS ESTATE',
 'odometer': 56133,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': 'TCB Group - Prime',
 'title': 'MERCEDES-BENZ C CLASS ESTATE C200 Sport Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'C200 Sport Premium 5dr Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569895%27 HTTP/1.1" 200 None
2025-11-27 19:01:55 [astonbarclay.gb] INFO: Saving data for 117569895: {'created_time': 1764270115.917458, 'last_price_update_time': 1764270115.917469, 'auction_closing_time': 1764610200.0}
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117569895') HTTP/1.1" 204 0
2025-11-27 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349
2025-11-27 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349
2025-11-27 19:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d676fcba-aed3-5836-a442-e4f524f9a29d with identifier: 116419349 to the API
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116419349?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd676fcba-aed3-5836-a442-e4f524f9a29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT19ZUD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116419349',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'MOKKA X DIESEL HATCHBACK',
 'odometer': 75885,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-29',
 'seller_name': 'TCB Group - Value',
 'title': 'VAUXHALL MOKKA X DIESEL HATCHBACK 1.6CDTi [136] Elite 5dr 4WD',
 'transmission': 'manual',
 'trim': '1.6CDTi [136] Elite 5dr 4WD',
 'vin': None,
 'year': 2019}
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116419349%27 HTTP/1.1" 200 None
2025-11-27 19:01:56 [astonbarclay.gb] INFO: Saving data for 116419349: {'auction_closing_time': 1764331200.0, 'created_time': 1762369385.840201, 'last_price_update_time': 1764270116.198215}
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116419349') HTTP/1.1" 204 0
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9dba90>
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue)
2025-11-27 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea34050>
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F002960af-458d-43ff-be43-0ad326595abe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb88350>
2025-11-27 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117517985
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517985%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117517985: 0
2025-11-27 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117449968
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117449968%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117449968: 0
2025-11-27 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117551950
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551950%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117551950: 1
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252Fa095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/a095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98a750>
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecea7d0>
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e953c10>
2025-11-27 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252Fe4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e93ba10>
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e93bcd0>
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252Fd6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e916250>
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:01:58 [astonbarclay.gb] INFO: Found listing with ID: 117265330
2025-11-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117265330%27 HTTP/1.1" 200 None
2025-11-27 19:01:59 [astonbarclay.gb] INFO: Scrape type for 117265330: 2
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252Fc8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec971d0>
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252Fbc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e912690>
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg?w=600 saved to cache
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue)
2025-11-27 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252Fb96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/b96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117458368?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eace110>
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252F2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe5dad0>
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/e436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117440886
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440886%27 HTTP/1.1" 200 None
2025-11-27 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117440886: 0
2025-11-27 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117444967
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444967%27 HTTP/1.1" 200 None
2025-11-27 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117444967: 0
2025-11-27 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117326194
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117326194%27 HTTP/1.1" 200 None
2025-11-27 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117326194: 2
2025-11-27 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116800442?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb2050>
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9e77cf10>
2025-11-27 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab8810>
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe37490>
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue)
2025-11-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/c23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec03490>
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd429d0>
2025-11-27 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:02:02 [astonbarclay.gb] INFO: Found listing with ID: 117565071
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117565071%27 HTTP/1.1" 200 None
2025-11-27 19:02:02 [astonbarclay.gb] INFO: Scrape type for 117565071: 1
2025-11-27 19:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fed3090>
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbeb90>
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:02:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117555734, 'registration': 'OU67YPJ', 'account': 'STA058', 'make': 'ABARTH', 'model': '595 HATCHBACK', 'derivative': '1.4 T-Jet 165 Turismo 3dr', 'mileage': 77988, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-03-19', 'doors': 3, 'engineSize': 1368, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e520f2d5-0ad7-4dd6-8998-a3369761ba29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117555734, 'registration': 'OU67YPJ', 'account': 'STA058', 'make': 'ABARTH', 'model': '595 HATCHBACK', 'derivative': '1.4 T-Jet 165 Turismo 3dr', 'mileage': 77988, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-03-19', 'doors': 3, 'engineSize': 1368, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e520f2d5-0ad7-4dd6-8998-a3369761ba29.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c3aea26-7716-513d-ab73-8a5cf3d68c52 with identifier: 117555734
2025-11-27 19:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52 with scrape type 1
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117458368, 'registration': 'YC72JOJ', 'account': 'NOR037', 'make': 'MERCEDES-BENZ', 'model': 'VITO 110 PROGRESSIVE CDI', 'derivative': None, 'mileage': 128941, 'mileageWarranty': True, 'type': 'car', 'saleId': 17858, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': None, 'engineSize': 1950, 'bodyType': 'Panel Van', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Northside Truck & Van Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 191, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2c9056c-9d9c-4993-b3b3-6418d897dddd.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2025-11-27 19:02:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117458368, 'registration': 'YC72JOJ', 'account': 'NOR037', 'make': 'MERCEDES-BENZ', 'model': 'VITO 110 PROGRESSIVE CDI', 'derivative': None, 'mileage': 128941, 'mileageWarranty': True, 'type': 'car', 'saleId': 17858, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': None, 'engineSize': 1950, 'bodyType': 'Panel Van', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Northside Truck & Van Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 191, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2c9056c-9d9c-4993-b3b3-6418d897dddd.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': '+VAT', 'value': '+VAT'}}
2025-11-27 19:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec8cff3d-331d-5743-a0ad-96b3f44e1ea8 with identifier: 117458368
2025-11-27 19:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec8cff3d-331d-5743-a0ad-96b3f44e1ea8 with scrape type 1
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ec8cff3d-331d-5743-a0ad-96b3f44e1ea8
2025-11-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ec8cff3d-331d-5743-a0ad-96b3f44e1ea8
2025-11-27 19:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec8cff3d-331d-5743-a0ad-96b3f44e1ea8, identifier: 117458368
2025-11-27 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/a095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec8cff3d-331d-5743-a0ad-96b3f44e1ea8 with identifier: 117458368
2025-11-27 19:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec8cff3d-331d-5743-a0ad-96b3f44e1ea8 with identifier: 117458368
2025-11-27 19:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'northside truck & van ltd', 'price_includes_vat': False, 'title': 'mercedes-benz vito 110 progressive cdi none', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'vito 110 progressive cdi', 'transmission': 'manual', 'engine': '1.9l', 'fuel_type': 'diesel', 'odometer': 128941, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458368', 'expiration_date': '2025-12-02t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': None, 'license_plate': 'yc72joj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': None, 'c_o_2_emission_value': 191, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': False, 'id': 'ec8cff3d-331d-5743-a0ad-96b3f44e1ea8', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz vito 110 progressive cdi', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 207509}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': 191,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': None,
     'emission_standard': 'euro 6',
     'engine': '1.9l',
     'expiration_date': '2025-12-02t10:00:00z',
     'fuel_type': 'diesel',
     'id': 'ec8cff3d-331d-5743-a0ad-96b3f44e1ea8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yc72joj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458368',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz vito 110 progressive cdi',
     'model': 'vito 110 progressive cdi',
     'odometer': 128941,
     'odometer_in_km': 207509,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-30',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'northside truck & van ltd',
     'title': 'mercedes-benz vito 110 progressive cdi none',
     'transmission': 'manual',
     'trim': None,
     'vin': None,
     'year': 2022}
2025-11-27 19:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ec8cff3d-331d-5743-a0ad-96b3f44e1ea8 spider: astonbarclay.gb
2025-11-27 19:02:03 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ec8cff3d-331d-5743-a0ad-96b3f44e1ea8 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'northside truck & van ltd', 'price_includes_vat': False, 'title': 'mercedes-benz vito 110 progressive cdi none', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'vito 110 progressive cdi', 'transmission': 'manual', 'engine': '1.9l', 'fuel_type': 'diesel', 'odometer': 128941, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458368', 'expiration_date': '2025-12-02t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': None, 'license_plate': 'yc72joj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': None, 'c_o_2_emission_value': 191, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': False, 'id': 'ec8cff3d-331d-5743-a0ad-96b3f44e1ea8', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz vito 110 progressive cdi', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 207509}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': 191,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': None,
     'emission_standard': 'euro 6',
     'engine': '1.9l',
     'expiration_date': '2025-12-02t10:00:00z',
     'fuel_type': 'diesel',
     'id': 'ec8cff3d-331d-5743-a0ad-96b3f44e1ea8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yc72joj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458368',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz vito 110 progressive cdi',
     'model': 'vito 110 progressive cdi',
     'odometer': 128941,
     'odometer_in_km': 207509,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-30',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'northside truck & van ltd',
     'title': 'mercedes-benz vito 110 progressive cdi none',
     'transmission': 'manual',
     'trim': None,
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': None,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ec8cff3d-331d-5743-a0ad-96b3f44e1ea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YC72JOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117458368',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'VITO 110 PROGRESSIVE CDI',
 'odometer': 128941,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Northside Truck & Van Ltd',
 'title': 'MERCEDES-BENZ VITO 110 PROGRESSIVE CDI None',
 'transmission': 'manual',
 'trim': None,
 'vin': None,
 'year': 2022}
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458368%27 HTTP/1.1" 200 None
2025-11-27 19:02:03 [astonbarclay.gb] INFO: Saving data for 117458368: {'created_time': 1764270123.4015, 'last_price_update_time': 1764270123.40151, 'auction_closing_time': 1764669600.0}
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117458368') HTTP/1.1" 204 0
2025-11-27 19:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e822810>
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252Fb9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb93690>
2025-11-27 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252Fe436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/e436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117553753, 'registration': 'VX18XCK', 'account': 'MER023', 'make': 'PORSCHE', 'model': 'MACAN ESTATE', 'derivative': 'GTS 5dr PDK', 'mileage': 65998, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-03-05', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 2997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VX18XCK/2025-11-27/image/47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/f7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/cf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/ccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/c8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/19 19K 04/21 30K 01/23 39K 11/24 59K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 210, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/597b8999-1745-42dc-8376-c8a702eb30c8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117553753, 'registration': 'VX18XCK', 'account': 'MER023', 'make': 'PORSCHE', 'model': 'MACAN ESTATE', 'derivative': 'GTS 5dr PDK', 'mileage': 65998, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-03-05', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 2997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VX18XCK/2025-11-27/image/47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/f7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/cf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/ccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/c8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/19 19K 04/21 30K 01/23 39K 11/24 59K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 210, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/597b8999-1745-42dc-8376-c8a702eb30c8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8aae69-a416-5368-b735-8d5505155280 with identifier: 117553753
2025-11-27 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8aae69-a416-5368-b735-8d5505155280 with scrape type 1
2025-11-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116800442, 'registration': 'WA66TVP', 'account': 'AST011', 'make': 'VOLKSWAGEN', 'model': 'PASSAT SALOON', 'derivative': '1.4 TSI GTE 4dr DSG', 'mileage': 78564, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-07', 'doors': 4, 'engineSize': 1395, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WA66TVP/2025-11-04/image/9949787c-74e7-4cee-b733-3ca3e7602149_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/a6eb7206-a596-4364-aa8d-1996a7ca7cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2b126097-61bd-4a59-819c-d7926b1118e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/cfde551f-b1e6-4931-932c-cef0c3ebe03f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/96499886-4cc8-4cc6-a9d9-585b7ae70edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/ab1b8341-b38d-4889-8369-8c61bbaf6a18_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2322bdb0-6126-40ac-82e0-9c1819479864_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2d68dfc8-8082-415b-beb9-66be5966dbfa_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/17-6K, 04/18-10K, 08/19-21K, 08/20-28K, 09/21- NO MILEAGE, 04/22-45K, 06/24-70K, 02/25-78K', 'remarks': 'SPARE KEY, VOSA STATES 21K 28K 35K 51K 64K 73K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 39, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8e1d8952-b4ac-4408-baa2-c96ef8ef61c8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116800442, 'registration': 'WA66TVP', 'account': 'AST011', 'make': 'VOLKSWAGEN', 'model': 'PASSAT SALOON', 'derivative': '1.4 TSI GTE 4dr DSG', 'mileage': 78564, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-05', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-07', 'doors': 4, 'engineSize': 1395, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WA66TVP/2025-11-04/image/9949787c-74e7-4cee-b733-3ca3e7602149_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/a6eb7206-a596-4364-aa8d-1996a7ca7cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2b126097-61bd-4a59-819c-d7926b1118e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/cfde551f-b1e6-4931-932c-cef0c3ebe03f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/96499886-4cc8-4cc6-a9d9-585b7ae70edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/ab1b8341-b38d-4889-8369-8c61bbaf6a18_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2322bdb0-6126-40ac-82e0-9c1819479864_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66TVP/2025-11-04/image/2d68dfc8-8082-415b-beb9-66be5966dbfa_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/17-6K, 04/18-10K, 08/19-21K, 08/20-28K, 09/21- NO MILEAGE, 04/22-45K, 06/24-70K, 02/25-78K', 'remarks': 'SPARE KEY, VOSA STATES 21K 28K 35K 51K 64K 73K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 39, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8e1d8952-b4ac-4408-baa2-c96ef8ef61c8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442
2025-11-27 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e537f8b-227e-5a67-90f6-18908247b543 with scrape type 2
2025-11-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e537f8b-227e-5a67-90f6-18908247b543 with scrape type 2
2025-11-27 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e537f8b-227e-5a67-90f6-18908247b543, identifier: 116800442
2025-11-27 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570740?view=catalogue)
2025-11-27 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue)
2025-11-27 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570326?view=catalogue)
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117440907
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440907%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117440907: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117450542
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450542%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117450542: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117266272
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117266272%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117266272: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117506317
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506317%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117506317: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117500624
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500624%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117500624: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117272731
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272731%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117272731: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117426992
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426992%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117426992: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117523252
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523252%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117523252: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117425969
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425969%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117425969: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117240197
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240197%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117240197: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117539274
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539274%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117539274: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117450014
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450014%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117450014: 0
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117254197
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117254197%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117254197: 2
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442
2025-11-27 19:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442
2025-11-27 19:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2e537f8b-227e-5a67-90f6-18908247b543 with identifier: 116800442 to the API
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272e537f8b-227e-5a67-90f6-18908247b543%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2e537f8b-227e-5a67-90f6-18908247b543: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116800442?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '2e537f8b-227e-5a67-90f6-18908247b543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WA66TVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116800442',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT SALOON',
 'odometer': 78564,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN PASSAT SALOON 1.4 TSI GTE 4dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI GTE 4dr DSG',
 'vin': None,
 'year': 2016}
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116800442%27 HTTP/1.1" 200 None
2025-11-27 19:02:04 [astonbarclay.gb] INFO: Saving data for 116800442: {'auction_closing_time': 1764669600.0, 'created_time': 1761764661.806895, 'last_price_update_time': 1764270124.72825}
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116800442') HTTP/1.1" 204 0
2025-11-27 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d287c50>
2025-11-27 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252Fbeedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e925210>
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c71be90>
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252Fc23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/c23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9020d0>
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue)
2025-11-27 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue)
2025-11-27 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HX17PZW/2025-11-27/image/b96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117456785?view=catalogue)
2025-11-27 19:02:05 [scrapy.extensions.logstats] INFO: Crawled 135 pages (at 71 pages/min), scraped 85 items (at 48 items/min)
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Ff7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/f7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117323884?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117433885?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec62cd0>
2025-11-27 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252F37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9f4ed0>
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570719?view=catalogue)
2025-11-27 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GP65ESU/2025-11-27/image/d1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117447787?view=catalogue)
2025-11-27 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117518990
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117518990%27 HTTP/1.1" 200 None
2025-11-27 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117518990: 0
2025-11-27 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117474058
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474058%27 HTTP/1.1" 200 None
2025-11-27 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117474058: 0
2025-11-27 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117293082
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117293082%27 HTTP/1.1" 200 None
2025-11-27 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117293082: 2
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e939dd0>
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252F6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e953950>
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252Fa095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/a095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/bea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c351790>
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDY65CRJ%252F2025-11-27%252Fimage%252F036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5
2025-11-27 19:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5, skipping ID generation
2025-11-27 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with scrape type 1
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 from tracking dictionaries
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 sending to next pipeline
2025-11-27 19:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5, identifier: 117570740
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd1a550>
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDS67TJV%252F2025-11-27%252Fimage%252Fc8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46
2025-11-27 19:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46, skipping ID generation
2025-11-27 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with scrape type 1
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 from tracking dictionaries
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 sending to next pipeline
2025-11-27 19:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46, identifier: 117568753
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb94210>
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHG16BWB%252F2025-11-27%252Fimage%252F3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7
2025-11-27 19:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb2475f9-755c-5bfc-a99a-39fc2a5593c7, skipping ID generation
2025-11-27 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7 with scrape type 1
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cb2475f9-755c-5bfc-a99a-39fc2a5593c7 from tracking dictionaries
2025-11-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb2475f9-755c-5bfc-a99a-39fc2a5593c7 sending to next pipeline
2025-11-27 19:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cb2475f9-755c-5bfc-a99a-39fc2a5593c7, identifier: 117570326
2025-11-27 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue)
2025-11-27 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117489830
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489830%27 HTTP/1.1" 200 None
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117489830: 0
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117456374
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117456374%27 HTTP/1.1" 200 None
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117456374: 0
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117447083
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447083%27 HTTP/1.1" 200 None
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117447083: 0
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117573622
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573622%27 HTTP/1.1" 200 None
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117573622: 1
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740
2025-11-27 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740
2025-11-27 19:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 35d30efe-ced7-5e4e-bf41-39ad7e9299d5 with identifier: 117570740 to the API
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '35d30efe-ced7-5e4e-bf41-39ad7e9299d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DY65CRJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570740',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA DIESEL SPORTS TOURER',
 'odometer': 68756,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31042,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/49386a77-4a99-4c29-8421-4ef9bf9ec9f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30203,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/002960af-458d-43ff-be43-0ad326595abe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34514,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/e4d56d88-bcd7-4698-9912-698ecceeb53e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34982,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/2655c2c8-552f-4e73-9165-5c8f8027f270_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40955,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/29e78e0c-b1b3-4015-b111-4e50919cbf17_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39959,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/b9f32420-146b-4462-9924-eab672d21c5a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64076,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/600914f7-e24b-447e-ad98-c6961bae2a3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35d30efe-ced7-5e4e-bf41-39ad7e9299d5/35d30efe-ced7-5e4e-bf41-39ad7e9299d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53706,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DY65CRJ/2025-11-27/image/036a17a5-32c2-44d6-9b8f-1464c85954c2_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': 'Manamanx Ltd',
 'title': 'VAUXHALL ASTRA DIESEL SPORTS TOURER 1.6 CDTi 16V ecoFLEX Design 5dr',
 'transmission': 'manual',
 'trim': '1.6 CDTi 16V ecoFLEX Design 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570740%27 HTTP/1.1" 200 None
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Saving data for 117570740: {'created_time': 1764270128.609167, 'last_price_update_time': 1764270128.609179, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570740') HTTP/1.1" 204 0
2025-11-27 19:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-11-27 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-11-27 19:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753 to the API
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'e2b6d930-d9f3-5dd0-8d98-f900c4b66f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS67TJV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117568753',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MAZDA',
 'model': 'CX-3 DIESEL HATCHBACK',
 'odometer': 65256,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32605,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31899,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33741,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32006,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67837,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63331,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2b6d930-d9f3-5dd0-8d98-f900c4b66f46/e2b6d930-d9f3-5dd0-8d98-f900c4b66f46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53372,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': 'Manamanx Ltd',
 'title': 'MAZDA CX-3 DIESEL HATCHBACK 1.5d Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '1.5d Sport Nav 5dr',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-11-27 19:02:08 [astonbarclay.gb] INFO: Saving data for 117568753: {'created_time': 1764270128.985777, 'last_price_update_time': 1764270128.985787, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117568753') HTTP/1.1" 204 0
2025-11-27 19:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cb2475f9-755c-5bfc-a99a-39fc2a5593c7 with identifier: 117570326
2025-11-27 19:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cb2475f9-755c-5bfc-a99a-39fc2a5593c7 with identifier: 117570326
2025-11-27 19:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cb2475f9-755c-5bfc-a99a-39fc2a5593c7 with identifier: 117570326 to the API
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'cb2475f9-755c-5bfc-a99a-39fc2a5593c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HG16BWB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570326',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK SPECIAL EDS',
 'odometer': 72450,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34504,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3194e900-1a9c-4284-a90d-f6bc664268f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34846,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/94112c5f-bf02-44a5-b091-a1464d086798_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34827,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/47fbe7b5-c6a4-4702-b13c-8eda5ca383dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32410,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/585d26dd-8a23-4810-b7af-1055cd6d7fd4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44458,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/8698429e-49db-4f5f-a8bb-c6f1c7441d56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42879,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/c23e8f4b-7df5-4a23-b368-6be0fe33a79b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39694,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/a095d5d0-c98d-45e6-bc17-eee230970d71_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2475f9-755c-5bfc-a99a-39fc2a5593c7/cb2475f9-755c-5bfc-a99a-39fc2a5593c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55393,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HG16BWB/2025-11-27/image/3f24c9d0-0030-4999-9e42-3f6304a084b1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': 'Manamanx Ltd',
 'title': 'VAUXHALL CORSA HATCHBACK SPECIAL EDS 1.2 Sting 3dr',
 'transmission': 'manual',
 'trim': '1.2 Sting 3dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570326%27 HTTP/1.1" 200 None
2025-11-27 19:02:09 [astonbarclay.gb] INFO: Saving data for 117570326: {'created_time': 1764270129.446304, 'last_price_update_time': 1764270129.446314, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570326') HTTP/1.1" 204 0
2025-11-27 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9845d0>
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252Ff9423201-b388-438f-930c-2094f02e0c41_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea84090>
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab0e10>
2025-11-27 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHX17PZW%252F2025-11-27%252Fimage%252Fb96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HX17PZW/2025-11-27/image/b96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2
2025-11-27 19:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49b2ae45-9f00-56fa-9e88-bc407694c7b2, skipping ID generation
2025-11-27 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2 with scrape type 1
2025-11-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 49b2ae45-9f00-56fa-9e88-bc407694c7b2 from tracking dictionaries
2025-11-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49b2ae45-9f00-56fa-9e88-bc407694c7b2 sending to next pipeline
2025-11-27 19:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 49b2ae45-9f00-56fa-9e88-bc407694c7b2, identifier: 117456785
2025-11-27 19:02:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117323884, 'registration': 'EO72LHB', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 39825, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 101, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO72LHB/2025-11-25/image/1402c3e9-cf15-4079-bf99-c440aae561ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/abda4e66-df03-442e-a610-21a5f9683105_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/32bc0122-1469-463d-8e13-9053b27415b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/5725fb64-1c4f-41a9-a4ef-6f94e5c03c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/4f4ba312-1fb6-41ad-8750-c3f5e64d0111_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/3872c46c-6fa3-41da-80ca-168f199b744d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/33b87da2-328e-41c1-9768-3c9084e6d952_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/ea1a71dc-071e-4370-88de-c40af40a8b18_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/6372c09b-039e-4f58-99ef-c99fa72a9279_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/aad20084-e8e7-45e8-9a57-007fe84075cd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/23- 13k, 06/25- 34k', 'remarks': 'ADAPTIONS REMOVED - HELPING HANDLE FRONT PASSENGER SIDE vosa - 38k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3caf2481-ac94-4b8d-b2a6-0304c1a6e5f1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117323884, 'registration': 'EO72LHB', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 39825, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 101, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO72LHB/2025-11-25/image/1402c3e9-cf15-4079-bf99-c440aae561ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/abda4e66-df03-442e-a610-21a5f9683105_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/32bc0122-1469-463d-8e13-9053b27415b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/5725fb64-1c4f-41a9-a4ef-6f94e5c03c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/4f4ba312-1fb6-41ad-8750-c3f5e64d0111_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/3872c46c-6fa3-41da-80ca-168f199b744d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/33b87da2-328e-41c1-9768-3c9084e6d952_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/ea1a71dc-071e-4370-88de-c40af40a8b18_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/6372c09b-039e-4f58-99ef-c99fa72a9279_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/aad20084-e8e7-45e8-9a57-007fe84075cd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/23- 13k, 06/25- 34k', 'remarks': 'ADAPTIONS REMOVED - HELPING HANDLE FRONT PASSENGER SIDE vosa - 38k spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3caf2481-ac94-4b8d-b2a6-0304c1a6e5f1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884
2025-11-27 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc24f454-acd3-5735-be2c-092338a240ed with scrape type 2
2025-11-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc24f454-acd3-5735-be2c-092338a240ed with scrape type 2
2025-11-27 19:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fc24f454-acd3-5735-be2c-092338a240ed, identifier: 117323884
2025-11-27 19:02:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117433885, 'registration': 'BV17UHF', 'account': 'THE109', 'make': 'LEXUS', 'model': 'CT HATCHBACK', 'derivative': '200h 1.8 Luxury 5dr CVT Auto', 'mileage': 26700, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-02-23', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV17UHF/2025-11-26/image/7d77ebbe-afc8-4bbf-8736-432f390a5a19_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/9dde3f46-09eb-4b6b-93da-a76f3db15f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/1b997fd2-ad76-439f-8651-3804e395efea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/c03a9e33-480f-468f-8e18-f6d01650ba04_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/3abd7710-37a9-4581-bfc1-b290a4cde5e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/fe4fa31f-0e97-4d2e-a79b-91544ac3ffe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/4a232255-78a3-490f-a55e-727333530759_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/88ba1965-cd91-4795-a810-b1ec8540d524_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85d7ec78-b816-4ce0-a92f-325fe0f1febb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117433885, 'registration': 'BV17UHF', 'account': 'THE109', 'make': 'LEXUS', 'model': 'CT HATCHBACK', 'derivative': '200h 1.8 Luxury 5dr CVT Auto', 'mileage': 26700, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-02-23', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BV17UHF/2025-11-26/image/7d77ebbe-afc8-4bbf-8736-432f390a5a19_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/9dde3f46-09eb-4b6b-93da-a76f3db15f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/1b997fd2-ad76-439f-8651-3804e395efea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/c03a9e33-480f-468f-8e18-f6d01650ba04_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/3abd7710-37a9-4581-bfc1-b290a4cde5e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/fe4fa31f-0e97-4d2e-a79b-91544ac3ffe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/4a232255-78a3-490f-a55e-727333530759_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV17UHF/2025-11-26/image/88ba1965-cd91-4795-a810-b1ec8540d524_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85d7ec78-b816-4ce0-a92f-325fe0f1febb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885
2025-11-27 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with scrape type 2
2025-11-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with scrape type 2
2025-11-27 19:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf, identifier: 117433885
2025-11-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Fcf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/cf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 49b2ae45-9f00-56fa-9e88-bc407694c7b2 with identifier: 117456785
2025-11-27 19:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 49b2ae45-9f00-56fa-9e88-bc407694c7b2 with identifier: 117456785
2025-11-27 19:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 49b2ae45-9f00-56fa-9e88-bc407694c7b2 with identifier: 117456785 to the API
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HX17PZW/2025-11-27/image/b96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '49b2ae45-9f00-56fa-9e88-bc407694c7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HX17PZW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117456785',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 92286,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35933,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/92b8379f-ec5c-42df-a773-255230a37538_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37065,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/31076ae0-7eb6-4bc9-8021-5b266d52a71c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34793,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/5cf83a50-a42d-4115-957b-859299ee2f64_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36013,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/9b578a7f-c1c5-4e56-98c6-f526b10c62a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54528,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/81065e6e-cc3e-4715-9377-757aeefe8243_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41906,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/38225b0f-b611-4cde-bc59-d48a0d562c2b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50239,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/e436c806-e395-4b10-b06c-8f993c3ecc29_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55986,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/4393d6cd-7624-45c9-be92-6935ba5940cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49328,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/6cfeaf4f-bdb4-4ea2-aa8b-a4cc65b8f4c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b2ae45-9f00-56fa-9e88-bc407694c7b2/49b2ae45-9f00-56fa-9e88-bc407694c7b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56518,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HX17PZW/2025-11-27/image/b96ebcbf-d052-41da-b9ab-51db9454031e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-15',
 'seller_name': 'TCB Group - Prime',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 180 AMG Line 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 180 AMG Line 4dr Tip Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117456785%27 HTTP/1.1" 200 None
2025-11-27 19:02:10 [astonbarclay.gb] INFO: Saving data for 117456785: {'created_time': 1764270130.970385, 'last_price_update_time': 1764270130.970395, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117456785') HTTP/1.1" 204 0
2025-11-27 19:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884
2025-11-27 19:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884
2025-11-27 19:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884 to the API
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fc24f454-acd3-5735-be2c-092338a240ed%27 HTTP/1.1" 200 None
2025-11-27 19:02:11 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fc24f454-acd3-5735-be2c-092338a240ed: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117323884?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'fc24f454-acd3-5735-be2c-092338a240ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO72LHB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117323884',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'ARKANA ESTATE',
 'odometer': 39825,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-04',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT ARKANA ESTATE 1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117323884%27 HTTP/1.1" 200 None
2025-11-27 19:02:11 [astonbarclay.gb] INFO: Saving data for 117323884: {'auction_closing_time': 1764670500.0, 'created_time': 1763492762.760874, 'last_price_update_time': 1764270131.255846}
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117323884') HTTP/1.1" 204 0
2025-11-27 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885
2025-11-27 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885
2025-11-27 19:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4cb975ab-d82f-5163-b48e-12f5bf23dfdf with identifier: 117433885 to the API
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274cb975ab-d82f-5163-b48e-12f5bf23dfdf%27 HTTP/1.1" 200 None
2025-11-27 19:02:11 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4cb975ab-d82f-5163-b48e-12f5bf23dfdf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:11 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117433885?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '4cb975ab-d82f-5163-b48e-12f5bf23dfdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV17UHF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117433885',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'LEXUS',
 'model': 'CT HATCHBACK',
 'odometer': 26700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': 'TCB Group - Prime',
 'title': 'LEXUS CT HATCHBACK 200h 1.8 Luxury 5dr CVT Auto',
 'transmission': 'automatic',
 'trim': '200h 1.8 Luxury 5dr CVT Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433885%27 HTTP/1.1" 200 None
2025-11-27 19:02:11 [astonbarclay.gb] INFO: Saving data for 117433885: {'created_time': 1764147708.70359, 'last_price_update_time': 1764270131.539375, 'auction_closing_time': 1764669600.0}
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117433885') HTTP/1.1" 204 0
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc7b10>
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF66FHH%252F2025-11-27%252Fimage%252F7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 948320e5-e8e7-5700-ac0d-311450e5b351
2025-11-27 19:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 948320e5-e8e7-5700-ac0d-311450e5b351, skipping ID generation
2025-11-27 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948320e5-e8e7-5700-ac0d-311450e5b351 with scrape type 1
2025-11-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 948320e5-e8e7-5700-ac0d-311450e5b351 from tracking dictionaries
2025-11-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 948320e5-e8e7-5700-ac0d-311450e5b351 sending to next pipeline
2025-11-27 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 948320e5-e8e7-5700-ac0d-311450e5b351, identifier: 117570719
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb78c10>
2025-11-27 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGP65ESU%252F2025-11-27%252Fimage%252Fd1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GP65ESU/2025-11-27/image/d1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e
2025-11-27 19:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af5a28f6-1785-52f1-98c5-fd68ffc2b60e, skipping ID generation
2025-11-27 19:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e with scrape type 1
2025-11-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af5a28f6-1785-52f1-98c5-fd68ffc2b60e from tracking dictionaries
2025-11-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af5a28f6-1785-52f1-98c5-fd68ffc2b60e sending to next pipeline
2025-11-27 19:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: af5a28f6-1785-52f1-98c5-fd68ffc2b60e, identifier: 117447787
2025-11-27 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue)
2025-11-27 19:02:12 [astonbarclay.gb] INFO: Found listing with ID: 117374304
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374304%27 HTTP/1.1" 200 None
2025-11-27 19:02:12 [astonbarclay.gb] INFO: Scrape type for 117374304: 0
2025-11-27 19:02:12 [astonbarclay.gb] INFO: Found listing with ID: 117579237
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579237%27 HTTP/1.1" 200 None
2025-11-27 19:02:12 [astonbarclay.gb] INFO: Scrape type for 117579237: 1
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719
2025-11-27 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719
2025-11-27 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 948320e5-e8e7-5700-ac0d-311450e5b351 with identifier: 117570719 to the API
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '948320e5-e8e7-5700-ac0d-311450e5b351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AF66FHH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570719',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'OPTIMA SALOON',
 'odometer': 36586,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31267,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/7efe941a-2bc3-4519-a32a-5059259e516e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27614,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/bc0c3df4-6827-40ac-8054-165fcbbbcc7d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30575,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/35360234-c078-4f1f-b24b-867f85e7ccbc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31149,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/f9423201-b388-438f-930c-2094f02e0c41_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50912,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/4a6959c1-446d-4358-b35c-e5a1a569183e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39702,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/beedc68e-95a5-4450-863c-eba0eabc891d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948320e5-e8e7-5700-ac0d-311450e5b351/948320e5-e8e7-5700-ac0d-311450e5b351_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50477,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/AF66FHH/2025-11-27/image/6fde6a56-2f86-429b-ba27-14247c10fcdf_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-16',
 'seller_name': 'Manamanx Ltd',
 'title': 'KIA OPTIMA SALOON 2.0 GDi PHEV 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 GDi PHEV 4dr Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570719%27 HTTP/1.1" 200 None
2025-11-27 19:02:12 [astonbarclay.gb] INFO: Saving data for 117570719: {'created_time': 1764270132.725713, 'last_price_update_time': 1764270132.725725, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570719') HTTP/1.1" 204 0
2025-11-27 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: af5a28f6-1785-52f1-98c5-fd68ffc2b60e with identifier: 117447787
2025-11-27 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: af5a28f6-1785-52f1-98c5-fd68ffc2b60e with identifier: 117447787
2025-11-27 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-11-27 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: af5a28f6-1785-52f1-98c5-fd68ffc2b60e spider: astonbarclay.gb
2025-11-27 19:02:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: af5a28f6-1785-52f1-98c5-fd68ffc2b60e due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'af5a28f6-1785-52f1-98c5-fd68ffc2b60e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GP65ESU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117447787',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'RIO HATCHBACK SPECIAL EDITIONS',
 'odometer': 77629,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34664,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/cdd0f55d-0c6a-4e37-99b9-3d9d8725abf2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38210,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/08afa072-35ed-422d-9626-ccfbaf41f5c1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33608,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/96356ada-58b0-44c0-b87d-f89a4ef3ce68_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36516,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/6c56d163-1825-488e-b7ee-052df88e846b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44773,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/680054c9-dac3-4762-b445-a388c903ebd0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52331,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/32c6612b-fecc-4f54-9ee6-68febc00ef5f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40363,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/7354832f-0e50-4ad6-8b90-808d442605cb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37262,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/d1d6c8f9-5c0d-42fc-9913-7fdb29a7e4c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5a28f6-1785-52f1-98c5-fd68ffc2b60e/af5a28f6-1785-52f1-98c5-fd68ffc2b60e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51289,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GP65ESU/2025-11-27/image/2dd8e7eb-8127-4ae0-a63c-fb4e64c4deda_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-12',
 'seller_name': 'TCB Group - Prime',
 'title': 'KIA RIO HATCHBACK SPECIAL EDITIONS 1.25 SR7 5dr',
 'transmission': 'manual',
 'trim': '1.25 SR7 5dr',
 'vin': None,
 'year': 2015}
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447787%27 HTTP/1.1" 200 None
2025-11-27 19:02:12 [astonbarclay.gb] INFO: Saving data for 117447787: {'created_time': 1764270132.945692, 'last_price_update_time': 1764270132.945704, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117447787') HTTP/1.1" 204 0
2025-11-27 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0dc10>
2025-11-27 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fbea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/bea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/f7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Fccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/ccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117490116?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd5a910>
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb87c10>
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue)
2025-11-27 19:02:13 [astonbarclay.gb] INFO: Found listing with ID: 117453051
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117453051%27 HTTP/1.1" 200 None
2025-11-27 19:02:13 [astonbarclay.gb] INFO: Scrape type for 117453051: 0
2025-11-27 19:02:13 [astonbarclay.gb] INFO: Found listing with ID: 117573049
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573049%27 HTTP/1.1" 200 None
2025-11-27 19:02:13 [astonbarclay.gb] INFO: Scrape type for 117573049: 1
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e910590>
2025-11-27 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e908c50>
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d2d31d0>
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fc7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/f1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fde9c50>
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9e77ebd0>
2025-11-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e958b10>
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue)
2025-11-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117407477
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407477%27 HTTP/1.1" 200 None
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117407477: 0
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 117374439
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374439%27 HTTP/1.1" 200 None
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Scrape type for 117374439: 0
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 116997163
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997163%27 HTTP/1.1" 200 None
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Scrape type for 116997163: 2
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117254197?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9032d0>
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Ff7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/f7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117490116, 'registration': 'DS21UKL', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Elite Nav 5dr Auto [8 Speed]', 'mileage': 64156, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-26', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fef4d4f4-804e-4727-9465-179cdcd1f202.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117490116, 'registration': 'DS21UKL', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Elite Nav 5dr Auto [8 Speed]', 'mileage': 64156, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-26', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fef4d4f4-804e-4727-9465-179cdcd1f202.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca3cd91-1a64-55d6-9cc3-2a52774227c8 with identifier: 117490116
2025-11-27 19:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca3cd91-1a64-55d6-9cc3-2a52774227c8 with scrape type 1
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3ca3cd91-1a64-55d6-9cc3-2a52774227c8
2025-11-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3ca3cd91-1a64-55d6-9cc3-2a52774227c8
2025-11-27 19:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3ca3cd91-1a64-55d6-9cc3-2a52774227c8, identifier: 117490116
2025-11-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/cf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117326194?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117265330?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3ca3cd91-1a64-55d6-9cc3-2a52774227c8 with identifier: 117490116
2025-11-27 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3ca3cd91-1a64-55d6-9cc3-2a52774227c8 with identifier: 117490116
2025-11-27 19:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3ca3cd91-1a64-55d6-9cc3-2a52774227c8 with identifier: 117490116 to the API
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273ca3cd91-1a64-55d6-9cc3-2a52774227c8%27 HTTP/1.1" 200 None
2025-11-27 19:02:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3ca3cd91-1a64-55d6-9cc3-2a52774227c8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117490116?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3ca3cd91-1a64-55d6-9cc3-2a52774227c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS21UKL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117490116',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 64156,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo Elite Nav 5dr Auto [8 '
          'Speed]',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Elite Nav 5dr Auto [8 Speed]',
 'vin': None,
 'year': 2021}
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117490116%27 HTTP/1.1" 200 None
2025-11-27 19:02:16 [astonbarclay.gb] INFO: Saving data for 117490116: {'created_time': 1764270136.414377, 'last_price_update_time': 1764270136.414386, 'auction_closing_time': 1764669600.0}
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117490116') HTTP/1.1" 204 0
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdf7b50>
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117565071, 'registration': 'LS72KOJ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Elite 5dr', 'mileage': 10507, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 109, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-11-09', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/b3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/ef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/d19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23- 4k, 12/24- 6k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be9b5c68-adf7-451b-8c7e-8b247294e37d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117565071, 'registration': 'LS72KOJ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Elite 5dr', 'mileage': 10507, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 109, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-11-09', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/b3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/ef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/d19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23- 4k, 12/24- 6k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be9b5c68-adf7-451b-8c7e-8b247294e37d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d12f42d-79b7-5921-b95e-0e1510c10421 with identifier: 117565071
2025-11-27 19:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d12f42d-79b7-5921-b95e-0e1510c10421 with scrape type 1
2025-11-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252F6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue)
2025-11-27 19:02:16 [astonbarclay.gb] INFO: Found listing with ID: 117550109
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550109%27 HTTP/1.1" 200 None
2025-11-27 19:02:16 [astonbarclay.gb] INFO: Scrape type for 117550109: 1
2025-11-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9f6bd0>
2025-11-27 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252F9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaee610>
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Ff1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/f1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaece90>
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/ccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Fc8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/c8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252F6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc2e10>
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd5a910>
2025-11-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117254197, 'registration': 'DX74MWA', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.2 Mild Hybrid Ultra ALLGRIP 5dr', 'mileage': 6141, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-11-28T12:00Z', 'lot': 122, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-09-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DX74MWA/2025-11-17/image/d07c5a1c-d594-44d4-af22-7eabac3f5889_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/f3cabcfa-abc1-475a-a472-3fd8bff72255_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/b396746a-0786-4415-a5ca-675a30a6760b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/4f0d8477-9a94-4af2-947a-cb7d44af4c9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/f79553f7-2afa-431a-b417-07fc4f655c96_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/cae9d2ac-a74e-425e-8267-67b3bbf5ac6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/8406e724-8a94-4710-8813-d15112b95d63_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/852c5044-4e8f-4f7a-a5e6-be95bf239f51_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'spare key & sd card in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4ea8eff-7c81-4126-b550-6de431731762.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117254197, 'registration': 'DX74MWA', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.2 Mild Hybrid Ultra ALLGRIP 5dr', 'mileage': 6141, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-11-28T12:00Z', 'lot': 122, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-09-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DX74MWA/2025-11-17/image/d07c5a1c-d594-44d4-af22-7eabac3f5889_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/f3cabcfa-abc1-475a-a472-3fd8bff72255_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/b396746a-0786-4415-a5ca-675a30a6760b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/4f0d8477-9a94-4af2-947a-cb7d44af4c9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/f79553f7-2afa-431a-b417-07fc4f655c96_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/cae9d2ac-a74e-425e-8267-67b3bbf5ac6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/8406e724-8a94-4710-8813-d15112b95d63_removebg.jpg?w=600', 'https://abimg003.imgix.net/DX74MWA/2025-11-17/image/852c5044-4e8f-4f7a-a5e6-be95bf239f51_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'spare key & sd card in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4ea8eff-7c81-4126-b550-6de431731762.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e276689a-6602-5755-a762-6a47e352bc08 with identifier: 117254197
2025-11-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e276689a-6602-5755-a762-6a47e352bc08 with scrape type 2
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e276689a-6602-5755-a762-6a47e352bc08 with scrape type 2
2025-11-27 19:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e276689a-6602-5755-a762-6a47e352bc08, identifier: 117254197
2025-11-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue)
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Found listing with ID: 117578069
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578069%27 HTTP/1.1" 200 None
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Scrape type for 117578069: 1
2025-11-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117293082?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e276689a-6602-5755-a762-6a47e352bc08 with identifier: 117254197
2025-11-27 19:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e276689a-6602-5755-a762-6a47e352bc08 with identifier: 117254197
2025-11-27 19:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e276689a-6602-5755-a762-6a47e352bc08 with identifier: 117254197 to the API
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117254197?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e276689a-6602-5755-a762-6a47e352bc08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DX74MWA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117254197',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SUZUKI',
 'model': 'SWIFT HATCHBACK',
 'odometer': 6141,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-29',
 'seller_name': 'Motability Operations',
 'title': 'SUZUKI SWIFT HATCHBACK 1.2 Mild Hybrid Ultra ALLGRIP 5dr',
 'transmission': 'manual',
 'trim': '1.2 Mild Hybrid Ultra ALLGRIP 5dr',
 'vin': None,
 'year': 2024}
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117254197%27 HTTP/1.1" 200 None
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Saving data for 117254197: {'auction_closing_time': 1764331200.0, 'created_time': 1763406163.482899, 'last_price_update_time': 1764270138.639893}
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117254197') HTTP/1.1" 204 0
2025-11-27 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea9ae50>
2025-11-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Fcf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/cf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117553459, 'registration': 'CF21OTU', 'account': 'MER023', 'make': 'MERCEDES-BENZ', 'model': 'GLA AMG HATCHBACK', 'derivative': 'GLA 35 4Matic 5dr Auto', 'mileage': 44180, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 08/22 7K 08/23 21K / INV 06/25 39K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 186, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5aa1fab7-883b-4574-93cc-e5b4fbdedfce.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117553459, 'registration': 'CF21OTU', 'account': 'MER023', 'make': 'MERCEDES-BENZ', 'model': 'GLA AMG HATCHBACK', 'derivative': 'GLA 35 4Matic 5dr Auto', 'mileage': 44180, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-06-30', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600', 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 08/22 7K 08/23 21K / INV 06/25 39K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 186, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5aa1fab7-883b-4574-93cc-e5b4fbdedfce.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459
2025-11-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with scrape type 1
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F04030498-1910-4153-9459-6b7e83377980_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117326194, 'registration': 'YUI4751', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr', 'mileage': 34972, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-11-28T12:00Z', 'lot': 108, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-05-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YUI4751/2025-11-20/image/fa295a0a-2d05-48a0-91a3-f1dc61a523d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/59ad0e20-f3fd-46b1-9a9a-fe8cb0bcd71d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/b1d1194c-e060-4246-b73c-9a2f360af4ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/77c41b1f-f5ce-4028-806e-dbee847f8a57_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/33a623e9-b602-45dc-b047-ba71e3b7682a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/9ae01126-d555-4bec-8e9d-4a552a40fc75_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/3c1d9991-2427-4d95-b2d6-28c4c3e38c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/50b5fb6a-9a33-4d8f-b454-65c747959ef9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/15f97048-24b3-47c8-8553-b6f7ef5bfb04_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/a8449699-cb19-433c-9746-ca3e285b285b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/efa9ba05-b3c7-41ff-819c-1834b3248822_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/b0b21853-6f67-4753-8418-b47bc1d7201f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/f14c3a4d-bc20-4635-aadf-66dac3a3e479_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/af8db869-ea56-44c9-b333-943360dca171_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/4b03a6e2-7363-4cca-bf9d-c35901a6ce67_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/168f754b-27e7-4e02-bef0-c2ab604e3945_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/48c43a5b-c909-4280-bc78-e9986e0fb4e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/00f98d34-97f9-49e4-9e13-96d80161999e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/ce95dfda-9bc5-4bea-9a0e-dca43ffbd8f1_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23- 12k, 06/24- 22k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/876b553c-6e91-4a7b-96c8-f4589789d9c3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117326194, 'registration': 'YUI4751', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr', 'mileage': 34972, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-11-28T12:00Z', 'lot': 108, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-05-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YUI4751/2025-11-20/image/fa295a0a-2d05-48a0-91a3-f1dc61a523d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/59ad0e20-f3fd-46b1-9a9a-fe8cb0bcd71d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/b1d1194c-e060-4246-b73c-9a2f360af4ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/77c41b1f-f5ce-4028-806e-dbee847f8a57_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/33a623e9-b602-45dc-b047-ba71e3b7682a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/9ae01126-d555-4bec-8e9d-4a552a40fc75_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/3c1d9991-2427-4d95-b2d6-28c4c3e38c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/50b5fb6a-9a33-4d8f-b454-65c747959ef9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/15f97048-24b3-47c8-8553-b6f7ef5bfb04_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/a8449699-cb19-433c-9746-ca3e285b285b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/efa9ba05-b3c7-41ff-819c-1834b3248822_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/b0b21853-6f67-4753-8418-b47bc1d7201f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/f14c3a4d-bc20-4635-aadf-66dac3a3e479_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/af8db869-ea56-44c9-b333-943360dca171_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/4b03a6e2-7363-4cca-bf9d-c35901a6ce67_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/168f754b-27e7-4e02-bef0-c2ab604e3945_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/48c43a5b-c909-4280-bc78-e9986e0fb4e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/00f98d34-97f9-49e4-9e13-96d80161999e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YUI4751/2025-11-20/image/ce95dfda-9bc5-4bea-9a0e-dca43ffbd8f1_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23- 12k, 06/24- 22k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/876b553c-6e91-4a7b-96c8-f4589789d9c3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e070f70-b2ff-5002-826d-0905427a68da with identifier: 117326194
2025-11-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e070f70-b2ff-5002-826d-0905427a68da with scrape type 2
2025-11-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e070f70-b2ff-5002-826d-0905427a68da with scrape type 2
2025-11-27 19:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1e070f70-b2ff-5002-826d-0905427a68da, identifier: 117326194
2025-11-27 19:02:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117265330, 'registration': 'CMZ4398', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.6 E-Tech Plug-in hybrid 160 Engineered 5dr Auto', 'mileage': 5399, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-11-28T12:00Z', 'lot': 105, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-11-24', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1390, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4256e801-7453-4b65-b4e3-7149fc277567_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/0027cd30-8c13-4ea7-b5ab-6da6bf2f18dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/e4a7374f-1a2a-4ef5-8ef5-231e208fab6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4d92fa93-a1b4-4b6d-9af7-4fbff6b30681_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/b5f065a8-33b1-42de-b7bf-fb874e755877_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4ee44bbd-1330-4d2b-8c6f-9a226bbf3d37_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/0432f604-613c-45f1-a632-d703a7eb5c12_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/ca3f6dea-8a83-40fd-a459-9664a5ca0833_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/35948bc7-5459-4e39-9f55-97802e885096_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4af8c288-461d-4b58-bb1e-7c65108b02ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/9bd25338-00d7-407b-b751-3759e0ad6925_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24- 3k', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c160bac-8c6b-4e4d-9a62-653860577957.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117265330, 'registration': 'CMZ4398', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.6 E-Tech Plug-in hybrid 160 Engineered 5dr Auto', 'mileage': 5399, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-11-28T12:00Z', 'lot': 105, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-11-24', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1390, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4256e801-7453-4b65-b4e3-7149fc277567_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/0027cd30-8c13-4ea7-b5ab-6da6bf2f18dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/e4a7374f-1a2a-4ef5-8ef5-231e208fab6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4d92fa93-a1b4-4b6d-9af7-4fbff6b30681_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/b5f065a8-33b1-42de-b7bf-fb874e755877_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4ee44bbd-1330-4d2b-8c6f-9a226bbf3d37_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/0432f604-613c-45f1-a632-d703a7eb5c12_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/ca3f6dea-8a83-40fd-a459-9664a5ca0833_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/35948bc7-5459-4e39-9f55-97802e885096_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/4af8c288-461d-4b58-bb1e-7c65108b02ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/CMZ4398/2025-11-17/image/9bd25338-00d7-407b-b751-3759e0ad6925_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24- 3k', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c160bac-8c6b-4e4d-9a62-653860577957.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe93ab9-30af-53ba-aa3a-cff1715e4533 with identifier: 117265330
2025-11-27 19:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe93ab9-30af-53ba-aa3a-cff1715e4533 with scrape type 2
2025-11-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe93ab9-30af-53ba-aa3a-cff1715e4533 with scrape type 2
2025-11-27 19:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ffe93ab9-30af-53ba-aa3a-cff1715e4533, identifier: 117265330
2025-11-27 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252F102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1e070f70-b2ff-5002-826d-0905427a68da with identifier: 117326194
2025-11-27 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1e070f70-b2ff-5002-826d-0905427a68da with identifier: 117326194
2025-11-27 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1e070f70-b2ff-5002-826d-0905427a68da with identifier: 117326194 to the API
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271e070f70-b2ff-5002-826d-0905427a68da%27 HTTP/1.1" 200 None
2025-11-27 19:02:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1e070f70-b2ff-5002-826d-0905427a68da: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117326194?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1e070f70-b2ff-5002-826d-0905427a68da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YUI4751',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117326194',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 34972,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-23',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.5 T-GDI Exclusive 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117326194%27 HTTP/1.1" 200 None
2025-11-27 19:02:19 [astonbarclay.gb] INFO: Saving data for 117326194: {'auction_closing_time': 1764331200.0, 'created_time': 1763492759.348883, 'last_price_update_time': 1764270139.579897}
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117326194') HTTP/1.1" 204 0
2025-11-27 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ffe93ab9-30af-53ba-aa3a-cff1715e4533 with identifier: 117265330
2025-11-27 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ffe93ab9-30af-53ba-aa3a-cff1715e4533 with identifier: 117265330
2025-11-27 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ffe93ab9-30af-53ba-aa3a-cff1715e4533 with identifier: 117265330 to the API
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ffe93ab9-30af-53ba-aa3a-cff1715e4533%27 HTTP/1.1" 200 None
2025-11-27 19:02:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ffe93ab9-30af-53ba-aa3a-cff1715e4533: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117265330?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '1.4L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'ffe93ab9-30af-53ba-aa3a-cff1715e4533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CMZ4398',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117265330',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 5399,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-24',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT CAPTUR HATCHBACK 1.6 E-Tech Plug-in hybrid 160 Engineered '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-Tech Plug-in hybrid 160 Engineered 5dr Auto',
 'vin': None,
 'year': 2023}
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117265330%27 HTTP/1.1" 200 None
2025-11-27 19:02:19 [astonbarclay.gb] INFO: Saving data for 117265330: {'auction_closing_time': 1764331200.0, 'created_time': 1763406163.839009, 'last_price_update_time': 1764270139.880735}
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117265330') HTTP/1.1" 204 0
2025-11-27 19:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec205d0>
2025-11-27 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/f7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117555734?view=catalogue)
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:20 [astonbarclay.gb] INFO: Found listing with ID: 117100098
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100098%27 HTTP/1.1" 200 None
2025-11-27 19:02:20 [astonbarclay.gb] INFO: Scrape type for 117100098: 2
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252Fd3f9b907-557e-403d-995e-03192204983f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573622?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e833a90>
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Fccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/ccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e997810>
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e985290>
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:02:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117551950, 'registration': 'MW72BVZ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA ELECTRIC HATCHBACK', 'derivative': '100kW GS Line 50kWh 5dr Auto', 'mileage': 15735, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 104, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/24- 10k, 03/25- 22k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa29dea9-962f-43e0-8ba7-9a6f77b82985.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117551950, 'registration': 'MW72BVZ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA ELECTRIC HATCHBACK', 'derivative': '100kW GS Line 50kWh 5dr Auto', 'mileage': 15735, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 104, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/24- 10k, 03/25- 22k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa29dea9-962f-43e0-8ba7-9a6f77b82985.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0095f406-b111-5807-86e4-82427de9e080 with identifier: 117551950
2025-11-27 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0095f406-b111-5807-86e4-82427de9e080 with scrape type 1
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fa6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579237?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe79510>
2025-11-27 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117293082, 'registration': 'KN71UFB', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 10533, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 703, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-01-11', 'fuel': 'Petrol', 'motExpiry': '2026-01-10', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KN71UFB/2025-11-25/image/dac7bb97-c09a-4f75-b003-91e932e2ec87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/48a1e3fc-44ad-4d4d-a4aa-8551aae291e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/44d7bb36-5efc-43da-8980-ac240ad1b2fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/741f9c24-ce9a-4565-9f5a-4bf5bebfe461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/6f5ac7b8-a0b7-44da-b6fd-debc1718c233_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/aec1073a-a8f1-4c90-a64a-8299cfff50ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/0b6d04f7-e8e8-43fc-be38-28f48cf598aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/403f9218-0fbc-4900-b1df-6037e64436e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/43676fdc-d9a1-4251-99d8-3153ad7d009f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/140bdd51-f66d-407f-9423-4128afa4762f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/23- 3k, 01/24- 5k, 12/24- 8k', 'remarks': 'ADAPTIONS REMOVED - HAND CONTROLS vosa - 8k spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3951cad-49a4-4186-a622-fa6b7c335073.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117293082, 'registration': 'KN71UFB', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 10533, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': 703, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-01-11', 'fuel': 'Petrol', 'motExpiry': '2026-01-10', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KN71UFB/2025-11-25/image/dac7bb97-c09a-4f75-b003-91e932e2ec87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/48a1e3fc-44ad-4d4d-a4aa-8551aae291e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/44d7bb36-5efc-43da-8980-ac240ad1b2fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/741f9c24-ce9a-4565-9f5a-4bf5bebfe461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/6f5ac7b8-a0b7-44da-b6fd-debc1718c233_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/aec1073a-a8f1-4c90-a64a-8299cfff50ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/0b6d04f7-e8e8-43fc-be38-28f48cf598aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/403f9218-0fbc-4900-b1df-6037e64436e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/43676fdc-d9a1-4251-99d8-3153ad7d009f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/140bdd51-f66d-407f-9423-4128afa4762f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/23- 3k, 01/24- 5k, 12/24- 8k', 'remarks': 'ADAPTIONS REMOVED - HAND CONTROLS vosa - 8k spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3951cad-49a4-4186-a622-fa6b7c335073.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082
2025-11-27 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8114833-4e43-522c-a956-8fdb9e93a239 with scrape type 2
2025-11-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8114833-4e43-522c-a956-8fdb9e93a239 with scrape type 2
2025-11-27 19:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c8114833-4e43-522c-a956-8fdb9e93a239, identifier: 117293082
2025-11-27 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:21 [astonbarclay.gb] INFO: Found listing with ID: 117374356
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374356%27 HTTP/1.1" 200 None
2025-11-27 19:02:21 [astonbarclay.gb] INFO: Scrape type for 117374356: 0
2025-11-27 19:02:21 [astonbarclay.gb] INFO: Found listing with ID: 117573197
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573197%27 HTTP/1.1" 200 None
2025-11-27 19:02:21 [astonbarclay.gb] INFO: Scrape type for 117573197: 1
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082
2025-11-27 19:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082
2025-11-27 19:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082 to the API
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117293082?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'c8114833-4e43-522c-a956-8fdb9e93a239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KN71UFB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117293082',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 10533,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo [130] Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo [130] Ultimate 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117293082%27 HTTP/1.1" 200 None
2025-11-27 19:02:21 [astonbarclay.gb] INFO: Saving data for 117293082: {'auction_closing_time': 1764670500.0, 'created_time': 1763492856.155598, 'last_price_update_time': 1764270141.698089}
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117293082') HTTP/1.1" 204 0
2025-11-27 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e92f690>
2025-11-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/c8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fb3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/b3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fedc4d0>
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fb9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea006d0>
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Ff7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/f7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd52090>
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU67YPJ%252F2025-11-27%252Fimage%252F19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52
2025-11-27 19:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c3aea26-7716-513d-ab73-8a5cf3d68c52, skipping ID generation
2025-11-27 19:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52 with scrape type 1
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0c3aea26-7716-513d-ab73-8a5cf3d68c52 from tracking dictionaries
2025-11-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c3aea26-7716-513d-ab73-8a5cf3d68c52 sending to next pipeline
2025-11-27 19:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0c3aea26-7716-513d-ab73-8a5cf3d68c52, identifier: 117555734
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec847d0>
2025-11-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573622, 'registration': 'BG22XVS', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI 200 GTD 5dr DSG', 'mileage': 38263, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-06-21', 'fuel': 'Diesel', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/23- 15k, 03/25- 30k', 'remarks': 'vosa - 37k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573622, 'registration': 'BG22XVS', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI 200 GTD 5dr DSG', 'mileage': 38263, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-06-21', 'fuel': 'Diesel', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/23- 15k, 03/25- 30k', 'remarks': 'vosa - 37k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc with identifier: 117573622
2025-11-27 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc with scrape type 1
2025-11-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc
2025-11-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc
2025-11-27 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc, identifier: 117573622
2025-11-27 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/ca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117507292
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507292%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117507292: 0
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117439361
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117439361%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117439361: 0
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117461164
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117461164%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117461164: 0
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117441882
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441882%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117441882: 0
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117457340
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457340%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117457340: 1
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252Fe7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0c3aea26-7716-513d-ab73-8a5cf3d68c52 with identifier: 117555734
2025-11-27 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0c3aea26-7716-513d-ab73-8a5cf3d68c52 with identifier: 117555734
2025-11-27 19:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0c3aea26-7716-513d-ab73-8a5cf3d68c52 with identifier: 117555734 to the API
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0c3aea26-7716-513d-ab73-8a5cf3d68c52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OU67YPJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117555734',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'ABARTH',
 'model': '595 HATCHBACK',
 'odometer': 77988,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29465,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/29773422-727d-4fc5-acd0-2df3ea158668_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29804,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/69a648d0-199e-4835-b833-88bd00a16d31_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25735,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/184eb5b6-93a3-46e8-bb40-dbb16405c434_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26852,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/56040ebf-4b3d-4bae-ac3d-43995ec70751_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54442,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/73e2e081-ef3b-40a1-88e4-a982982b6aab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55116,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19a74121-96a4-402b-87e6-d5aaa24003ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c3aea26-7716-513d-ab73-8a5cf3d68c52/0c3aea26-7716-513d-ab73-8a5cf3d68c52_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62283,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OU67YPJ/2025-11-27/image/19b52620-b57e-40d2-b7d9-934f02e040c7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-22',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'ABARTH 595 HATCHBACK 1.4 T-Jet 165 Turismo 3dr',
 'transmission': 'manual',
 'trim': '1.4 T-Jet 165 Turismo 3dr',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555734%27 HTTP/1.1" 200 None
2025-11-27 19:02:23 [astonbarclay.gb] INFO: Saving data for 117555734: {'created_time': 1764270143.761958, 'last_price_update_time': 1764270143.761971, 'auction_closing_time': 1764669600.0}
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117555734') HTTP/1.1" 204 0
2025-11-27 19:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc with identifier: 117573622
2025-11-27 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc with identifier: 117573622
2025-11-27 19:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc with identifier: 117573622 to the API
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc%27 HTTP/1.1" 200 None
2025-11-27 19:02:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117573622?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Diesel',
 'id': 'a59299fe-2ccd-5dc3-ba5a-0ed33eea6acc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG22XVS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573622',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 38263,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI 200 GTD 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 200 GTD 5dr DSG',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573622%27 HTTP/1.1" 200 None
2025-11-27 19:02:24 [astonbarclay.gb] INFO: Saving data for 117573622: {'created_time': 1764270144.044761, 'last_price_update_time': 1764270144.044769, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573622') HTTP/1.1" 204 0
2025-11-27 19:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d2d9310>
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252F6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec8abd0>
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579237, 'registration': 'CK25LYW', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 [63] Premium 5dr [Nav]', 'mileage': 13951, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2025-03-07', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579237, 'registration': 'CK25LYW', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.0 [63] Premium 5dr [Nav]', 'mileage': 13951, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2025-03-07', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a17b6a59-b2d2-59d3-befc-2d7e11a434cd with identifier: 117579237
2025-11-27 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a17b6a59-b2d2-59d3-befc-2d7e11a434cd with scrape type 1
2025-11-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a17b6a59-b2d2-59d3-befc-2d7e11a434cd
2025-11-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a17b6a59-b2d2-59d3-befc-2d7e11a434cd
2025-11-27 19:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a17b6a59-b2d2-59d3-befc-2d7e11a434cd, identifier: 117579237
2025-11-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/ef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fa4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a17b6a59-b2d2-59d3-befc-2d7e11a434cd with identifier: 117579237
2025-11-27 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a17b6a59-b2d2-59d3-befc-2d7e11a434cd with identifier: 117579237
2025-11-27 19:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a17b6a59-b2d2-59d3-befc-2d7e11a434cd with identifier: 117579237 to the API
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a17b6a59-b2d2-59d3-befc-2d7e11a434cd%27 HTTP/1.1" 200 None
2025-11-27 19:02:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a17b6a59-b2d2-59d3-befc-2d7e11a434cd: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117579237?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'a17b6a59-b2d2-59d3-befc-2d7e11a434cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CK25LYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579237',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'I10 HATCHBACK',
 'odometer': 13951,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-07',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI I10 HATCHBACK 1.0 [63] Premium 5dr [Nav]',
 'transmission': 'manual',
 'trim': '1.0 [63] Premium 5dr [Nav]',
 'vin': None,
 'year': 2025}
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579237%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Saving data for 117579237: {'created_time': 1764270145.019075, 'last_price_update_time': 1764270145.019086, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579237') HTTP/1.1" 204 0
2025-11-27 19:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d164fd0>
2025-11-27 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117370840
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117370840%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117370840: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 116891450
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891450%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 116891450: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 116866753
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116866753%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 116866753: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 116895357
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116895357%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 116895357: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 116891404
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891404%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 116891404: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441850
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441850%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441850: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 116981133
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116981133%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 116981133: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117216157
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117216157%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117216157: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117511008
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117511008%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117511008: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117164114
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117164114: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441325
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441325%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441325: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117497624
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117497624%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117497624: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117402228
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402228%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117402228: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117415483
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415483%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117415483: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117275648
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117275648%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117275648: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441111
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441111%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441111: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117458552
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458552%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117458552: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441007
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441007%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441007: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441892
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441892%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441892: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117460212
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117460212%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117460212: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441140
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441140%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441140: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117440988
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440988%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117440988: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441149
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441149%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441149: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441120
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441120%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441120: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117418653
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418653%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117418653: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117434938
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117434938%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117434938: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117404928
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404928%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117404928: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117404919
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404919%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117404919: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117402164
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402164%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117402164: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441307
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441307%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441307: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441019
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441019%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441019: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117423639
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117423639%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117423639: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441346
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441346%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441346: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441410
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441410%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441410: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441337
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441337%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441337: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117448541
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117448541%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117448541: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441860
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441860%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441860: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117441870
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441870%27 HTTP/1.1" 200 None
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117441870: 0
2025-11-27 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117253439
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253439%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117253439: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 116807925
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116807925%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 116807925: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117247051
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117247051%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117247051: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 116851903
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116851903%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 116851903: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117272128
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272128%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117272128: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117366912
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366912%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117366912: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117441190
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441190%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117441190: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117441204
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441204%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117441204: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117422403
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422403%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117422403: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117348473
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117348473%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117348473: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117475684
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475684%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117475684: 0
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117532070
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117532070%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117532070: 1
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252Fc15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550109?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117405538?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fef72d0>
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252Fc8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/c8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec11ad0>
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252F6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VX18XCK/2025-11-27/image/9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553753?view=catalogue)
2025-11-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/ef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd90150>
2025-11-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F04030498-1910-4153-9459-6b7e83377980_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec62910>
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252Fca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/ca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea992d0>
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117399764
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399764%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117399764: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117444914
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444914%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117444914: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 116891417
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891417%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 116891417: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117444372
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444372%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117444372: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117441244
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441244%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117441244: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117441537
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441537%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117441537: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117404939
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404939%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117404939: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117492135
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492135%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117492135: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117428857
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117428857%27 HTTP/1.1" 200 None
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Scrape type for 117428857: 0
2025-11-27 19:02:27 [astonbarclay.gb] INFO: Found listing with ID: 117555034
2025-11-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555034%27 HTTP/1.1" 200 None
2025-11-27 19:02:28 [astonbarclay.gb] INFO: Scrape type for 117555034: 1
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbc350>
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e912e50>
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/ef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb67e90>
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252F102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/b3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fd19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/d19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe7aa50>
2025-11-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdfe350>
2025-11-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252Fd3f9b907-557e-403d-995e-03192204983f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550109, 'registration': 'DF23VLZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 22126, 'mileageWarranty': False, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/25-19k', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550109, 'registration': 'DF23VLZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 22126, 'mileageWarranty': False, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/25-19k', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109
2025-11-27 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2beed525-84c0-53df-923c-e6049e3dd55e with scrape type 1
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2beed525-84c0-53df-923c-e6049e3dd55e
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2beed525-84c0-53df-923c-e6049e3dd55e
2025-11-27 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2beed525-84c0-53df-923c-e6049e3dd55e, identifier: 117550109
2025-11-27 19:02:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117405538, 'registration': 'SH66ZTW', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'ADAM HATCHBACK SPECIAL EDS', 'derivative': '1.2i Energised 3dr', 'mileage': 62917, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-23', 'doors': 3, 'engineSize': 1229, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/7ab2a190-ab17-4d00-8524-e75b1e6972d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/8d2f50c4-7a6e-4084-8b3a-281d85447563_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/de95aed1-4630-461c-bfc6-fb281fc28300_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/18afe3d0-3c71-42d3-9a9e-9118d8f39cc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/ea55a05f-99e5-4902-84b5-df54cff6b028_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/309b7fd2-a502-4236-b77f-311cbb04d80d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/ec6a611f-1c0c-4dc8-bd78-9cdadcb6d3d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/122533c2-5787-4eac-be30-f28c0390a89a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K- 51K - 54K - 59K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f93f54eb-6f23-49a4-9c6e-cf2e036529d8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117405538, 'registration': 'SH66ZTW', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'ADAM HATCHBACK SPECIAL EDS', 'derivative': '1.2i Energised 3dr', 'mileage': 62917, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-23', 'doors': 3, 'engineSize': 1229, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/7ab2a190-ab17-4d00-8524-e75b1e6972d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/8d2f50c4-7a6e-4084-8b3a-281d85447563_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/de95aed1-4630-461c-bfc6-fb281fc28300_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/18afe3d0-3c71-42d3-9a9e-9118d8f39cc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/ea55a05f-99e5-4902-84b5-df54cff6b028_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/309b7fd2-a502-4236-b77f-311cbb04d80d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/ec6a611f-1c0c-4dc8-bd78-9cdadcb6d3d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SH66ZTW/2025-11-21/image/122533c2-5787-4eac-be30-f28c0390a89a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K- 51K - 54K - 59K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f93f54eb-6f23-49a4-9c6e-cf2e036529d8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de91efcc-b45a-5389-be87-94f3e2e61d99 with identifier: 117405538
2025-11-27 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de91efcc-b45a-5389-be87-94f3e2e61d99 with scrape type 2
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de91efcc-b45a-5389-be87-94f3e2e61d99 with scrape type 2
2025-11-27 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: de91efcc-b45a-5389-be87-94f3e2e61d99, identifier: 117405538
2025-11-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:29 [astonbarclay.gb] INFO: Found listing with ID: 117555641
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555641%27 HTTP/1.1" 200 None
2025-11-27 19:02:29 [astonbarclay.gb] INFO: Scrape type for 117555641: 1
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252Fde6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573049?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116997163?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117578069?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117505465?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109
2025-11-27 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109
2025-11-27 19:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109 to the API
2025-11-27 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272beed525-84c0-53df-923c-e6049e3dd55e%27 HTTP/1.1" 200 None
2025-11-27 19:02:30 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2beed525-84c0-53df-923c-e6049e3dd55e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550109?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '2beed525-84c0-53df-923c-e6049e3dd55e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DF23VLZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550109',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 22126,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550109%27 HTTP/1.1" 200 None
2025-11-27 19:02:30 [astonbarclay.gb] INFO: Saving data for 117550109: {'created_time': 1764270150.137986, 'last_price_update_time': 1764270150.137995, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550109') HTTP/1.1" 204 0
2025-11-27 19:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: de91efcc-b45a-5389-be87-94f3e2e61d99 with identifier: 117405538
2025-11-27 19:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: de91efcc-b45a-5389-be87-94f3e2e61d99 with identifier: 117405538
2025-11-27 19:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: de91efcc-b45a-5389-be87-94f3e2e61d99 with identifier: 117405538 to the API
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117405538?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'de91efcc-b45a-5389-be87-94f3e2e61d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SH66ZTW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405538',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ADAM HATCHBACK SPECIAL EDS',
 'odometer': 62917,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-31',
 'seller_name': 'Manamanx Ltd',
 'title': 'VAUXHALL ADAM HATCHBACK SPECIAL EDS 1.2i Energised 3dr',
 'transmission': 'manual',
 'trim': '1.2i Energised 3dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405538%27 HTTP/1.1" 200 None
2025-11-27 19:02:30 [astonbarclay.gb] INFO: Saving data for 117405538: {'auction_closing_time': 1764331200.0, 'created_time': 1763751931.665184, 'last_price_update_time': 1764270150.544491}
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405538') HTTP/1.1" 204 0
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecae7d0>
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVX18XCK%252F2025-11-27%252Fimage%252F9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VX18XCK/2025-11-27/image/9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf8aae69-a416-5368-b735-8d5505155280
2025-11-27 19:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf8aae69-a416-5368-b735-8d5505155280, skipping ID generation
2025-11-27 19:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8aae69-a416-5368-b735-8d5505155280 with scrape type 1
2025-11-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bf8aae69-a416-5368-b735-8d5505155280 from tracking dictionaries
2025-11-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf8aae69-a416-5368-b735-8d5505155280 sending to next pipeline
2025-11-27 19:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bf8aae69-a416-5368-b735-8d5505155280, identifier: 117553753
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8febb150>
2025-11-27 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fa6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bf8aae69-a416-5368-b735-8d5505155280 with identifier: 117553753
2025-11-27 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bf8aae69-a416-5368-b735-8d5505155280 with identifier: 117553753
2025-11-27 19:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bf8aae69-a416-5368-b735-8d5505155280 with identifier: 117553753 to the API
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/VX18XCK/2025-11-27/image/9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 210,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bf8aae69-a416-5368-b735-8d5505155280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VX18XCK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117553753',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'PORSCHE',
 'model': 'MACAN ESTATE',
 'odometer': 65998,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31524,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/47c6deea-6b61-40ff-b3b6-295a53e5ae70_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31656,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/f7e455d2-4896-4f32-ba49-cd2f40b3a73c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29308,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/7b744cf9-75ec-4241-9dc4-33bd6aafdc30_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27786,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/cf17a992-20a2-4d8c-acc1-9c7114f3ab2d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39692,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/ccfed923-7b4f-45b4-aaf2-13bc275f3090_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106648,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/0f953a7d-30c9-4f85-8e4f-c0f98ae43138_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99069,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/1323fe44-0771-46f7-aaa3-d94d4a0909b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46842,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/c8d6879e-682e-4464-92f1-5a17c819d6df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40839,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/76a1aa4f-88dd-4cee-91d7-1030ae70dd1a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8aae69-a416-5368-b735-8d5505155280/bf8aae69-a416-5368-b735-8d5505155280_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47348,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VX18XCK/2025-11-27/image/9f263621-b635-4b50-8cff-3b5bf2f6ddea_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'PORSCHE MACAN ESTATE GTS 5dr PDK',
 'transmission': 'automatic',
 'trim': 'GTS 5dr PDK',
 'vin': None,
 'year': 2018}
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553753%27 HTTP/1.1" 200 None
2025-11-27 19:02:31 [astonbarclay.gb] INFO: Saving data for 117553753: {'created_time': 1764270151.652224, 'last_price_update_time': 1764270151.652234, 'auction_closing_time': 1764669600.0}
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117553753') HTTP/1.1" 204 0
2025-11-27 19:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee3690>
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe8d450>
2025-11-27 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:32 [astonbarclay.gb] INFO: Found listing with ID: 117543370
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543370%27 HTTP/1.1" 200 None
2025-11-27 19:02:32 [astonbarclay.gb] INFO: Scrape type for 117543370: 1
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252Fc5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573197?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eca0dd0>
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fb3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/b3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/ef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117100098?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e915250>
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252Fe7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e90b550>
2025-11-27 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e90f110>
2025-11-27 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573049, 'registration': 'DS73UTJ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 4286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-11-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573049, 'registration': 'DS73UTJ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 4286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-11-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049
2025-11-27 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 239579f9-3161-5982-a032-dd293c2c3386 with scrape type 1
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 239579f9-3161-5982-a032-dd293c2c3386
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 239579f9-3161-5982-a032-dd293c2c3386
2025-11-27 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 239579f9-3161-5982-a032-dd293c2c3386, identifier: 117573049
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116997163, 'registration': 'SK72VEL', 'account': 'ARN179', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Edition 5dr Auto', 'mileage': 89785, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK72VEL/2025-11-10/image/e00c1dbd-98ba-4283-a5a9-e594f3d7817d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/7f074e58-373c-42c7-a081-04c791af1b45_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/e2a7cc37-4c10-4cb2-a8f9-bb9f750da3bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/a7821f5c-78a8-4976-98ff-d9d8cce8f63d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/54e197e5-709f-4968-acb0-ce6188e51538_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/a71ed08e-b598-492c-9205-49232cd28919_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/0bd1f655-6d20-4b06-b5e0-c19916db91bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/efd9410e-dab9-483a-b2dd-f1a05f1d0954_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/19574c84-f29f-4e64-af01-0742748c0b9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/e139dbfe-d8b2-45e9-bb48-de2b3cfadc35_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/f785bef8-f1c0-4a97-8dcb-1b7566c5c56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/8dde5945-f152-4f36-a135-36550cdaef3d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/23-12K, 08/23-25K, 01/24-37K, 06/24-50K, 10/24-62K, 03/25-75K, 08/25-88K', 'remarks': 'SPARE KEY + SD CARD IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark Contract Hire', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5688f5f-fc9c-4e83-805f-0c8c5789d4f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116997163, 'registration': 'SK72VEL', 'account': 'ARN179', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Edition 5dr Auto', 'mileage': 89785, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-03', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SK72VEL/2025-11-10/image/e00c1dbd-98ba-4283-a5a9-e594f3d7817d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/7f074e58-373c-42c7-a081-04c791af1b45_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/e2a7cc37-4c10-4cb2-a8f9-bb9f750da3bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/a7821f5c-78a8-4976-98ff-d9d8cce8f63d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/54e197e5-709f-4968-acb0-ce6188e51538_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/a71ed08e-b598-492c-9205-49232cd28919_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/0bd1f655-6d20-4b06-b5e0-c19916db91bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/efd9410e-dab9-483a-b2dd-f1a05f1d0954_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/19574c84-f29f-4e64-af01-0742748c0b9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/e139dbfe-d8b2-45e9-bb48-de2b3cfadc35_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/f785bef8-f1c0-4a97-8dcb-1b7566c5c56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK72VEL/2025-11-10/image/8dde5945-f152-4f36-a135-36550cdaef3d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/23-12K, 08/23-25K, 01/24-37K, 06/24-50K, 10/24-62K, 03/25-75K, 08/25-88K', 'remarks': 'SPARE KEY + SD CARD IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark Contract Hire', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5688f5f-fc9c-4e83-805f-0c8c5789d4f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 227b2c43-913e-5176-be4a-b3d7ccd9f7f8 with identifier: 116997163
2025-11-27 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227b2c43-913e-5176-be4a-b3d7ccd9f7f8 with scrape type 2
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 227b2c43-913e-5176-be4a-b3d7ccd9f7f8 with scrape type 2
2025-11-27 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 227b2c43-913e-5176-be4a-b3d7ccd9f7f8, identifier: 116997163
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117578069, 'registration': 'AMZ9892', 'account': 'MOT070', 'make': 'FORD', 'model': 'TOURNEO CONNECT DIESEL ESTATE', 'derivative': '2.0 EcoBlue Titanium 5dr [7 seat]', 'mileage': 15871, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-05-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117578069, 'registration': 'AMZ9892', 'account': 'MOT070', 'make': 'FORD', 'model': 'TOURNEO CONNECT DIESEL ESTATE', 'derivative': '2.0 EcoBlue Titanium 5dr [7 seat]', 'mileage': 15871, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-05-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff7219db-1e14-5fc3-914b-11820f823d1b with identifier: 117578069
2025-11-27 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff7219db-1e14-5fc3-914b-11820f823d1b with scrape type 1
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ff7219db-1e14-5fc3-914b-11820f823d1b
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ff7219db-1e14-5fc3-914b-11820f823d1b
2025-11-27 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ff7219db-1e14-5fc3-914b-11820f823d1b, identifier: 117578069
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117505465, 'registration': 'WD65MZY', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d Sport 5dr', 'mileage': 93421, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2026-02-13', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD65MZY/2025-11-26/image/417c7904-883d-4f80-a29d-9c01f8adec89_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/24215431-a43d-4e8c-b146-d7b2abf755f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/74018754-21e2-47e5-b37b-0e934f2c14be_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/cb64053a-dcb4-4cee-94bb-b92192a12fa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/2c96efb9-9d7e-464a-ac6c-cd34f73c1018_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/a1cc2ac2-3ae5-4a08-b7cb-452e8ff2ea39_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/6301dd69-bc8b-4a55-ac53-0b4f7e052bb9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 06/25 ??', 'remarks': 'VOSA STATES, 68K, 75K, 82K, 89K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cafdc7e-5f9b-4861-a9be-8689cb0b0b10.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117505465, 'registration': 'WD65MZY', 'account': 'MAN037', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d Sport 5dr', 'mileage': 93421, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2026-02-13', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD65MZY/2025-11-26/image/417c7904-883d-4f80-a29d-9c01f8adec89_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/24215431-a43d-4e8c-b146-d7b2abf755f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/74018754-21e2-47e5-b37b-0e934f2c14be_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/cb64053a-dcb4-4cee-94bb-b92192a12fa3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/2c96efb9-9d7e-464a-ac6c-cd34f73c1018_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/a1cc2ac2-3ae5-4a08-b7cb-452e8ff2ea39_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD65MZY/2025-11-26/image/6301dd69-bc8b-4a55-ac53-0b4f7e052bb9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 06/25 ??', 'remarks': 'VOSA STATES, 68K, 75K, 82K, 89K', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cafdc7e-5f9b-4861-a9be-8689cb0b0b10.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c28929-7947-5c11-b8e5-d7fd60c409e5 with identifier: 117505465
2025-11-27 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c28929-7947-5c11-b8e5-d7fd60c409e5 with scrape type 2
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9c28929-7947-5c11-b8e5-d7fd60c409e5 with scrape type 2
2025-11-27 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c9c28929-7947-5c11-b8e5-d7fd60c409e5, identifier: 117505465
2025-11-27 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Found listing with ID: 117573893
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573893%27 HTTP/1.1" 200 None
2025-11-27 19:02:33 [astonbarclay.gb] INFO: Scrape type for 117573893: 1
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049
2025-11-27 19:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049
2025-11-27 19:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049 to the API
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27239579f9-3161-5982-a032-dd293c2c3386%27 HTTP/1.1" 200 None
2025-11-27 19:02:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 239579f9-3161-5982-a032-dd293c2c3386: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117573049?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '239579f9-3161-5982-a032-dd293c2c3386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS73UTJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573049',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND HATCHBACK',
 'odometer': 4286,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-15',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL GRANDLAND HATCHBACK 1.2 Turbo Ultimate 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Ultimate 5dr',
 'vin': None,
 'year': 2023}
2025-11-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573049%27 HTTP/1.1" 200 None
2025-11-27 19:02:34 [astonbarclay.gb] INFO: Saving data for 117573049: {'created_time': 1764270154.003047, 'last_price_update_time': 1764270154.003059, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573049') HTTP/1.1" 204 0
2025-11-27 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 227b2c43-913e-5176-be4a-b3d7ccd9f7f8 with identifier: 116997163
2025-11-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 227b2c43-913e-5176-be4a-b3d7ccd9f7f8 with identifier: 116997163
2025-11-27 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 227b2c43-913e-5176-be4a-b3d7ccd9f7f8 with identifier: 116997163 to the API
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27227b2c43-913e-5176-be4a-b3d7ccd9f7f8%27 HTTP/1.1" 200 None
2025-11-27 19:02:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 227b2c43-913e-5176-be4a-b3d7ccd9f7f8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116997163?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '227b2c43-913e-5176-be4a-b3d7ccd9f7f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SK72VEL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116997163',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MAZDA',
 'model': 'CX-5 ESTATE',
 'odometer': 89785,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seller_name': 'Arnold Clark Contract Hire',
 'title': 'MAZDA CX-5 ESTATE 2.0 Sport Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Sport Edition 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997163%27 HTTP/1.1" 200 None
2025-11-27 19:02:34 [astonbarclay.gb] INFO: Saving data for 116997163: {'auction_closing_time': 1764670500.0, 'created_time': 1762455779.093144, 'last_price_update_time': 1764270154.295408}
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116997163') HTTP/1.1" 204 0
2025-11-27 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ff7219db-1e14-5fc3-914b-11820f823d1b with identifier: 117578069
2025-11-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ff7219db-1e14-5fc3-914b-11820f823d1b with identifier: 117578069
2025-11-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo connect diesel estate' containing 'tourneo'
2025-11-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ff7219db-1e14-5fc3-914b-11820f823d1b spider: astonbarclay.gb
2025-11-27 19:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ff7219db-1e14-5fc3-914b-11820f823d1b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo connect diesel estate' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Diesel',
 'id': 'ff7219db-1e14-5fc3-914b-11820f823d1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AMZ9892',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117578069',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'TOURNEO CONNECT DIESEL ESTATE',
 'odometer': 15871,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-31',
 'seller_name': 'Motability Operations',
 'title': 'FORD TOURNEO CONNECT DIESEL ESTATE 2.0 EcoBlue Titanium 5dr [7 '
          'seat]',
 'transmission': 'manual',
 'trim': '2.0 EcoBlue Titanium 5dr [7 seat]',
 'vin': None,
 'year': 2023}
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578069%27 HTTP/1.1" 200 None
2025-11-27 19:02:34 [astonbarclay.gb] INFO: Saving data for 117578069: {'created_time': 1764270154.510933, 'last_price_update_time': 1764270154.510943, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117578069') HTTP/1.1" 204 0
2025-11-27 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c9c28929-7947-5c11-b8e5-d7fd60c409e5 with identifier: 117505465
2025-11-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c9c28929-7947-5c11-b8e5-d7fd60c409e5 with identifier: 117505465
2025-11-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150346 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150346
2025-11-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c9c28929-7947-5c11-b8e5-d7fd60c409e5 spider: astonbarclay.gb
2025-11-27 19:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c9c28929-7947-5c11-b8e5-d7fd60c409e5 due to rule: high_mileage_for_country.json, error: 150346 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150346
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'c9c28929-7947-5c11-b8e5-d7fd60c409e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WD65MZY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117505465',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 93421,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'Manamanx Ltd',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d Sport 5dr',
 'transmission': 'manual',
 'trim': '116d Sport 5dr',
 'vin': None,
 'year': 2015}
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505465%27 HTTP/1.1" 200 None
2025-11-27 19:02:34 [astonbarclay.gb] INFO: Saving data for 117505465: {'auction_closing_time': 1764610200.0, 'created_time': 1764147692.246074, 'last_price_update_time': 1764270154.765615}
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117505465') HTTP/1.1" 204 0
2025-11-27 19:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0e4410>
2025-11-27 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fa4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea85450>
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Ffde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/e1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/d3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/d19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117565071?view=catalogue)
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117405024?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd0bd0>
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252Fc15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd47b50>
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573197, 'registration': 'LM72KUB', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 Hybrid N-Connecta 5dr Auto', 'mileage': 10948, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/23- 2k, 08/24- 5k', 'remarks': 'vosa - 9k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573197, 'registration': 'LM72KUB', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 Hybrid N-Connecta 5dr Auto', 'mileage': 10948, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-17', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 09/23- 2k, 08/24- 5k', 'remarks': 'vosa - 9k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9739bc1-b6cf-5fc5-be27-d1ab99bf8906 with identifier: 117573197
2025-11-27 19:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9739bc1-b6cf-5fc5-be27-d1ab99bf8906 with scrape type 1
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f9739bc1-b6cf-5fc5-be27-d1ab99bf8906
2025-11-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f9739bc1-b6cf-5fc5-be27-d1ab99bf8906
2025-11-27 19:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f9739bc1-b6cf-5fc5-be27-d1ab99bf8906, identifier: 117573197
2025-11-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:36 [astonbarclay.gb] INFO: Found listing with ID: 117510413
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117510413%27 HTTP/1.1" 200 None
2025-11-27 19:02:36 [astonbarclay.gb] INFO: Scrape type for 117510413: 1
2025-11-27 19:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f9739bc1-b6cf-5fc5-be27-d1ab99bf8906 with identifier: 117573197
2025-11-27 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f9739bc1-b6cf-5fc5-be27-d1ab99bf8906 with identifier: 117573197
2025-11-27 19:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f9739bc1-b6cf-5fc5-be27-d1ab99bf8906 with identifier: 117573197 to the API
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f9739bc1-b6cf-5fc5-be27-d1ab99bf8906%27 HTTP/1.1" 200 None
2025-11-27 19:02:36 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f9739bc1-b6cf-5fc5-be27-d1ab99bf8906: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117573197?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'f9739bc1-b6cf-5fc5-be27-d1ab99bf8906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LM72KUB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573197',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 10948,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN JUKE HATCHBACK 1.6 Hybrid N-Connecta 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Hybrid N-Connecta 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573197%27 HTTP/1.1" 200 None
2025-11-27 19:02:36 [astonbarclay.gb] INFO: Saving data for 117573197: {'created_time': 1764270156.394594, 'last_price_update_time': 1764270156.394605, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573197') HTTP/1.1" 204 0
2025-11-27 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab0b90>
2025-11-27 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/ef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117100098, 'registration': 'LL70ZNW', 'account': 'ARN218', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 155 S Edition 5dr EDC', 'mileage': 15073, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-01-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/d6a4493b-4cab-45af-b3e7-703158b20456_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/e551a330-a6d3-42d0-9010-13a8061baa0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/dde6f4c9-71f5-4841-9900-2eeaca7bc3c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/f173b789-3b14-410f-ab34-a9d816ddb870_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/5d597209-e89f-47b8-a4a6-141e4315459c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/6651a0f7-9b97-43b7-9806-b37925ab1444_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/012e5fa9-aa8e-466d-81ba-c77475e4f595_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/c390cf07-8126-4f65-a01b-a09c85901d37_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': 'Cat N Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/25- 12k', 'remarks': 'Category N Insurance Loss. No Structural Damage and Repairable - Insurer Decided Not to Repair CAT N - NON-STRUCTURAL - Damage is normal wear and minor dents/scratches CAT N - NON-STRUCTURAL - Damage is water/flood and mechanical vosa@ 8k, 10k, 13k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6035811e-3c76-49e5-9eae-3663822e007b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117100098, 'registration': 'LL70ZNW', 'account': 'ARN218', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 155 S Edition 5dr EDC', 'mileage': 15073, 'mileageWarranty': True, 'type': 'car', 'saleId': 17790, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-02T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-01-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/d6a4493b-4cab-45af-b3e7-703158b20456_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/e551a330-a6d3-42d0-9010-13a8061baa0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/dde6f4c9-71f5-4841-9900-2eeaca7bc3c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/f173b789-3b14-410f-ab34-a9d816ddb870_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/5d597209-e89f-47b8-a4a6-141e4315459c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/6651a0f7-9b97-43b7-9806-b37925ab1444_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/012e5fa9-aa8e-466d-81ba-c77475e4f595_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/c390cf07-8126-4f65-a01b-a09c85901d37_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': 'Cat N Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/25- 12k', 'remarks': 'Category N Insurance Loss. No Structural Damage and Repairable - Insurer Decided Not to Repair CAT N - NON-STRUCTURAL - Damage is normal wear and minor dents/scratches CAT N - NON-STRUCTURAL - Damage is water/flood and mechanical vosa@ 8k, 10k, 13k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6035811e-3c76-49e5-9eae-3663822e007b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a503e9-3915-5374-8d02-c01114cb6b48 with identifier: 117100098
2025-11-27 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a503e9-3915-5374-8d02-c01114cb6b48 with scrape type 2
2025-11-27 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9a503e9-3915-5374-8d02-c01114cb6b48 with scrape type 2
2025-11-27 19:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a9a503e9-3915-5374-8d02-c01114cb6b48, identifier: 117100098
2025-11-27 19:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a9a503e9-3915-5374-8d02-c01114cb6b48 with identifier: 117100098
2025-11-27 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a9a503e9-3915-5374-8d02-c01114cb6b48 with identifier: 117100098
2025-11-27 19:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a9a503e9-3915-5374-8d02-c01114cb6b48 with identifier: 117100098 to the API
2025-11-27 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a9a503e9-3915-5374-8d02-c01114cb6b48%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a9a503e9-3915-5374-8d02-c01114cb6b48: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117100098?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'a9a503e9-3915-5374-8d02-c01114cb6b48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL70ZNW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117100098',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 15073,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seller_name': 'Arnold Clark',
 'title': 'RENAULT CAPTUR HATCHBACK 1.3 TCE 155 S Edition 5dr EDC',
 'transmission': 'automatic',
 'trim': '1.3 TCE 155 S Edition 5dr EDC',
 'vin': None,
 'year': 2021}
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100098%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Saving data for 117100098: {'auction_closing_time': 1764670500.0, 'created_time': 1762887720.416408, 'last_price_update_time': 1764270157.36107}
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117100098') HTTP/1.1" 204 0
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdfca90>
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Found listing with ID: 117415492
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415492%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Scrape type for 117415492: 0
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Found listing with ID: 117475216
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475216%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Scrape type for 117475216: 0
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Found listing with ID: 117482022
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117482022%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Scrape type for 117482022: 0
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Found listing with ID: 117424304
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424304%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Scrape type for 117424304: 0
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Found listing with ID: 117506668
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506668%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Scrape type for 117506668: 0
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Found listing with ID: 117175645
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175645%27 HTTP/1.1" 200 None
2025-11-27 19:02:37 [astonbarclay.gb] INFO: Scrape type for 117175645: 2
2025-11-27 19:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe3b7d0>
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Fe1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/e1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3ab50>
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e93ae50>
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb88c50>
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fd3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/d3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd78290>
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLS72KOJ%252F2025-11-27%252Fimage%252Fd19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/d19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d12f42d-79b7-5921-b95e-0e1510c10421
2025-11-27 19:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d12f42d-79b7-5921-b95e-0e1510c10421, skipping ID generation
2025-11-27 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d12f42d-79b7-5921-b95e-0e1510c10421 with scrape type 1
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7d12f42d-79b7-5921-b95e-0e1510c10421 from tracking dictionaries
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d12f42d-79b7-5921-b95e-0e1510c10421 sending to next pipeline
2025-11-27 19:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7d12f42d-79b7-5921-b95e-0e1510c10421, identifier: 117565071
2025-11-27 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd7a310>
2025-11-27 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117405024, 'registration': 'LB19DXU', 'account': 'MAN037', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 Active X 5dr', 'mileage': 93146, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB19DXU/2025-11-21/image/30bebbf5-9e32-476f-9eb7-9290c462dcd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/0a2f419f-c3b1-42a8-99f1-80d9cc351326_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/7118ea94-e9ac-482f-8aa9-7816419f17f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/a6c46552-c454-4086-a4f4-63c8e1817bc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/106edf01-be1d-4005-a3a5-6ea220defb89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/77d06d9b-546d-44e4-a248-24ba57641e68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/d8fd734f-c778-41e1-bfd2-90fed1c7219f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/76911e9e-8b0e-4b0c-ac26-5ca023ef6e83_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/bbd85a7a-718c-4b4a-afcd-940af2cc3406_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/20 16K - 05/22 32K - 06/23 48K - 03/24 63K', 'remarks': 'VOSA STATES 36K - 56K- 74K - 92K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0b6f9fc-2c2b-4872-a73d-e003e0adc07d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117405024, 'registration': 'LB19DXU', 'account': 'MAN037', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 Active X 5dr', 'mileage': 93146, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB19DXU/2025-11-21/image/30bebbf5-9e32-476f-9eb7-9290c462dcd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/0a2f419f-c3b1-42a8-99f1-80d9cc351326_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/7118ea94-e9ac-482f-8aa9-7816419f17f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/a6c46552-c454-4086-a4f4-63c8e1817bc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/106edf01-be1d-4005-a3a5-6ea220defb89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/77d06d9b-546d-44e4-a248-24ba57641e68_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/d8fd734f-c778-41e1-bfd2-90fed1c7219f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/76911e9e-8b0e-4b0c-ac26-5ca023ef6e83_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19DXU/2025-11-21/image/bbd85a7a-718c-4b4a-afcd-940af2cc3406_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/20 16K - 05/22 32K - 06/23 48K - 03/24 63K', 'remarks': 'VOSA STATES 36K - 56K- 74K - 92K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0b6f9fc-2c2b-4872-a73d-e003e0adc07d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab3828ff-eba9-5302-bbbc-093f525fc747 with identifier: 117405024
2025-11-27 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab3828ff-eba9-5302-bbbc-093f525fc747 with scrape type 2
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab3828ff-eba9-5302-bbbc-093f525fc747 with scrape type 2
2025-11-27 19:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ab3828ff-eba9-5302-bbbc-093f525fc747, identifier: 117405024
2025-11-27 19:02:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117457340, 'registration': 'PE68ZXH', 'account': 'VAN045', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 VVT-i Icon Tech 5dr', 'mileage': 59215, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-09-19', 'fuel': 'Petrol', 'motExpiry': '2026-05-23', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/c61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/19 - 10K, 09/19 - 20K, 12/20 - 30K, 10/20 - 39K, 05/21 - 45K, 05/22 - 48K, 05/24 - 54K, 05/25 - 57K', 'remarks': '**1275**VOSA STATES 45K, 48K, 51K, 54K, 57K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a51cb26-6a89-4d7d-81a6-5017bedb55bc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117457340, 'registration': 'PE68ZXH', 'account': 'VAN045', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 VVT-i Icon Tech 5dr', 'mileage': 59215, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-09-19', 'fuel': 'Petrol', 'motExpiry': '2026-05-23', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/c61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 03/19 - 10K, 09/19 - 20K, 12/20 - 30K, 10/20 - 39K, 05/21 - 45K, 05/22 - 48K, 05/24 - 54K, 05/25 - 57K', 'remarks': '**1275**VOSA STATES 45K, 48K, 51K, 54K, 57K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a51cb26-6a89-4d7d-81a6-5017bedb55bc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 308654c0-2c11-5d85-a4d4-a706cc1d695f with identifier: 117457340
2025-11-27 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308654c0-2c11-5d85-a4d4-a706cc1d695f with scrape type 1
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252Fe46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/c198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7d12f42d-79b7-5921-b95e-0e1510c10421 with identifier: 117565071
2025-11-27 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7d12f42d-79b7-5921-b95e-0e1510c10421 with identifier: 117565071
2025-11-27 19:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7d12f42d-79b7-5921-b95e-0e1510c10421 with identifier: 117565071 to the API
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/d19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '7d12f42d-79b7-5921-b95e-0e1510c10421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS72KOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117565071',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND HATCHBACK',
 'odometer': 10507,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31080,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6d86eee1-c38d-4f32-9ba9-e6aead8f50e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/6984d554-1927-4e27-b91a-a980e443cb09_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33831,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/102aa2d4-4c3c-4d6b-a3e3-52b646be31a8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34614,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a6c9220f-54c4-46ad-bd54-35ec1c39c291_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42416,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/b3164a67-24b3-4393-93d3-15fddc99a925_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51501,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/a4565cde-8ef1-49db-aeff-75e1508afcc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56450,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/ef613985-1073-4068-aa89-3a2737c1e4fa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d12f42d-79b7-5921-b95e-0e1510c10421/7d12f42d-79b7-5921-b95e-0e1510c10421_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55803,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LS72KOJ/2025-11-27/image/d19f0bc7-0c5a-4210-9ff8-863db5d4b6c4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL GRANDLAND HATCHBACK 1.2 Turbo Elite 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Elite 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117565071%27 HTTP/1.1" 200 None
2025-11-27 19:02:39 [astonbarclay.gb] INFO: Saving data for 117565071: {'created_time': 1764270159.964803, 'last_price_update_time': 1764270159.964814, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117565071') HTTP/1.1" 204 0
2025-11-27 19:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ab3828ff-eba9-5302-bbbc-093f525fc747 with identifier: 117405024
2025-11-27 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ab3828ff-eba9-5302-bbbc-093f525fc747 with identifier: 117405024
2025-11-27 19:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ab3828ff-eba9-5302-bbbc-093f525fc747 with identifier: 117405024 to the API
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117405024?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ab3828ff-eba9-5302-bbbc-093f525fc747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB19DXU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405024',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 93146,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': 'Manamanx Ltd',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 140 Active X 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 140 Active X 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405024%27 HTTP/1.1" 200 None
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Saving data for 117405024: {'auction_closing_time': 1764331200.0, 'created_time': 1763752008.057962, 'last_price_update_time': 1764270160.286065}
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405024') HTTP/1.1" 204 0
2025-11-27 19:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee3750>
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252Fde6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 116134889
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116134889%27 HTTP/1.1" 200 None
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Scrape type for 116134889: 0
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 116755943
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116755943%27 HTTP/1.1" 200 None
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Scrape type for 116755943: 0
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 117508080
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508080%27 HTTP/1.1" 200 None
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Scrape type for 117508080: 0
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Found listing with ID: 117290737
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290737%27 HTTP/1.1" 200 None
2025-11-27 19:02:40 [astonbarclay.gb] INFO: Scrape type for 117290737: 2
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553459?view=catalogue)
2025-11-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue)
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaf15d0>
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb61fd0>
2025-11-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eacd050>
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252Fc5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8febf250>
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/fcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:41 [astonbarclay.gb] INFO: Found listing with ID: 117330721
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117330721%27 HTTP/1.1" 200 None
2025-11-27 19:02:41 [astonbarclay.gb] INFO: Scrape type for 117330721: 2
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9d8310>
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252Fc198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/c198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9d87d0>
2025-11-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb78b90>
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252Fefc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea00350>
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Ffaef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117049073?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:42 [astonbarclay.gb] INFO: Found listing with ID: 117121214
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121214%27 HTTP/1.1" 200 None
2025-11-27 19:02:42 [astonbarclay.gb] INFO: Scrape type for 117121214: 2
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117555034?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe7ac50>
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCF21OTU%252F2025-11-27%252Fimage%252F550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620
2025-11-27 19:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc17995d-aa9a-58e1-aeca-5d47c7b7a620, skipping ID generation
2025-11-27 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with scrape type 1
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dc17995d-aa9a-58e1-aeca-5d47c7b7a620 from tracking dictionaries
2025-11-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc17995d-aa9a-58e1-aeca-5d47c7b7a620 sending to next pipeline
2025-11-27 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dc17995d-aa9a-58e1-aeca-5d47c7b7a620, identifier: 117553459
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec97390>
2025-11-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMW72BVZ%252F2025-11-27%252Fimage%252F5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0095f406-b111-5807-86e4-82427de9e080
2025-11-27 19:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0095f406-b111-5807-86e4-82427de9e080, skipping ID generation
2025-11-27 19:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0095f406-b111-5807-86e4-82427de9e080 with scrape type 1
2025-11-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0095f406-b111-5807-86e4-82427de9e080 from tracking dictionaries
2025-11-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0095f406-b111-5807-86e4-82427de9e080 sending to next pipeline
2025-11-27 19:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0095f406-b111-5807-86e4-82427de9e080, identifier: 117551950
2025-11-27 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459
2025-11-27 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459
2025-11-27 19:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dc17995d-aa9a-58e1-aeca-5d47c7b7a620 with identifier: 117553459 to the API
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'dc17995d-aa9a-58e1-aeca-5d47c7b7a620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CF21OTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117553459',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA AMG HATCHBACK',
 'odometer': 44180,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25013,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/04030498-1910-4153-9459-6b7e83377980_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25138,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/d3f9b907-557e-403d-995e-03192204983f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25760,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/12d51d06-b6c6-4602-8776-c02585544f32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25951,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/e7d8bb38-bcaf-4459-8a2f-7aa0c080ecc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38840,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/c15ced79-abd0-4a9f-ab97-b68a6fd932f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101879,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/7319d5f3-30c4-44fa-a7c5-29b893c498fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74611,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/0962f658-318e-4448-a8dc-c0b2a98d201b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43908,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/02af8490-2394-47f3-b9f8-02e31646a072_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc17995d-aa9a-58e1-aeca-5d47c7b7a620/dc17995d-aa9a-58e1-aeca-5d47c7b7a620_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40791,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CF21OTU/2025-11-27/image/550d091e-60ed-456a-adb0-e2f503db409b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'MERCEDES-BENZ GLA AMG HATCHBACK GLA 35 4Matic 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 35 4Matic 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553459%27 HTTP/1.1" 200 None
2025-11-27 19:02:43 [astonbarclay.gb] INFO: Saving data for 117553459: {'created_time': 1764270163.69096, 'last_price_update_time': 1764270163.690969, 'auction_closing_time': 1764669600.0}
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117553459') HTTP/1.1" 204 0
2025-11-27 19:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0095f406-b111-5807-86e4-82427de9e080 with identifier: 117551950
2025-11-27 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0095f406-b111-5807-86e4-82427de9e080 with identifier: 117551950
2025-11-27 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15735, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950', 'expiration_date': '2025-12-02t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '100kw gs line 50kwh 5dr auto', 'license_plate': 'mw72bvz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '0095f406-b111-5807-86e4-82427de9e080', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32636}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56573}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47171}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43064}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'vauxhall mokka electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 25322} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-02t10:15:00z',
     'fuel_type': 'electric',
     'id': '0095f406-b111-5807-86e4-82427de9e080',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'mw72bvz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka electric hatchback',
     'model': 'mokka electric hatchback',
     'odometer': 15735,
     'odometer_in_km': 25322,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30704,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32636,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30863,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29731,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56573,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47171,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48571,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43064,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'motability operations',
     'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw gs line 50kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 0095f406-b111-5807-86e4-82427de9e080 spider: astonbarclay.gb
2025-11-27 19:02:43 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0095f406-b111-5807-86e4-82427de9e080 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15735, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950', 'expiration_date': '2025-12-02t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '100kw gs line 50kwh 5dr auto', 'license_plate': 'mw72bvz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '0095f406-b111-5807-86e4-82427de9e080', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32636}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56573}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47171}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48571}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43064}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'vauxhall mokka electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 25322} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-02t10:15:00z',
     'fuel_type': 'electric',
     'id': '0095f406-b111-5807-86e4-82427de9e080',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'mw72bvz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka electric hatchback',
     'model': 'mokka electric hatchback',
     'odometer': 15735,
     'odometer_in_km': 25322,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30704,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32636,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30863,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29731,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56573,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47171,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48571,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43064,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'motability operations',
     'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw gs line 50kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-02T10:15:00Z',
 'fuel_type': 'Electric',
 'id': '0095f406-b111-5807-86e4-82427de9e080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MW72BVZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'MOKKA ELECTRIC HATCHBACK',
 'odometer': 15735,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30704,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32636,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30863,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29731,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56573,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47171,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48571,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0095f406-b111-5807-86e4-82427de9e080/0095f406-b111-5807-86e4-82427de9e080_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43064,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA ELECTRIC HATCHBACK 100kW GS Line 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW GS Line 50kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551950%27 HTTP/1.1" 200 None
2025-11-27 19:02:44 [astonbarclay.gb] INFO: Saving data for 117551950: {'created_time': 1764270164.014593, 'last_price_update_time': 1764270164.014604, 'auction_closing_time': 1764670500.0}
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117551950') HTTP/1.1" 204 0
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe08150>
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fb08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c726f50>
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Ffcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/fcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:02:44 [astonbarclay.gb] INFO: Found listing with ID: 117424383
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424383%27 HTTP/1.1" 200 None
2025-11-27 19:02:44 [astonbarclay.gb] INFO: Scrape type for 117424383: 0
2025-11-27 19:02:44 [astonbarclay.gb] INFO: Found listing with ID: 114089759
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114089759%27 HTTP/1.1" 200 None
2025-11-27 19:02:44 [astonbarclay.gb] INFO: Scrape type for 114089759: 0
2025-11-27 19:02:44 [astonbarclay.gb] INFO: Found listing with ID: 117242983
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242983%27 HTTP/1.1" 200 None
2025-11-27 19:02:44 [astonbarclay.gb] INFO: Scrape type for 117242983: 2
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252Fe67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/e53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/ea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117555641?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117189741?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb03ad0>
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0b71d0>
2025-11-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece5950>
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb01cd0>
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117543370, 'registration': 'DP21RWW', 'account': 'VAN052', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 40301, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-06-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-16', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg?w=600', 'https://abimg002.imgix.net/8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg?w=600', 'https://abimg002.imgix.net/1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg?w=600', 'https://abimg002.imgix.net/30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg?w=600', 'https://abimg002.imgix.net/7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg?w=600', 'https://abimg002.imgix.net/f75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg?w=600', 'https://abimg002.imgix.net/963ad14f-f915-40ef-befc-03303fe17d82.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 29K, 37K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117543370, 'registration': 'DP21RWW', 'account': 'VAN052', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 40301, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-06-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-16', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg?w=600', 'https://abimg002.imgix.net/8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg?w=600', 'https://abimg002.imgix.net/1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg?w=600', 'https://abimg002.imgix.net/30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg?w=600', 'https://abimg002.imgix.net/7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg?w=600', 'https://abimg002.imgix.net/f75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg?w=600', 'https://abimg002.imgix.net/963ad14f-f915-40ef-befc-03303fe17d82.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 29K, 37K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4561a44-dba3-5e92-af4c-a7f723947a96 with identifier: 117543370
2025-11-27 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4561a44-dba3-5e92-af4c-a7f723947a96 with scrape type 1
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg?w=600 not downloaded yet
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117049073, 'registration': 'SL67EDP', 'account': 'MAN037', 'make': 'HYUNDAI', 'model': 'SANTA FE DIESEL ESTATE', 'derivative': '2.2 CRDi Blue Drive Premium SE 5dr [7 Seats]', 'mileage': 99982, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-10-19', 'fuel': 'Diesel', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 2199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SL67EDP/2025-11-07/image/5dd11dab-32fe-46ef-bdf3-902d5171a77a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/10bfce8f-3edd-46e4-a6eb-5c0859a53d2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/f2720bea-52b5-4480-8863-caeef6a0eff9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/34bcc908-d49f-40da-bba0-c6f6c14b5aba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/583ecf73-9d6a-4fa1-884e-cd3d0709197d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/7cfd2c5b-7714-43cd-8067-68afb51a5cf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/d15098f6-7d3a-493e-9992-d09c97683f9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/567019a8-8375-4503-9b3e-bc5c48ec78d2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 05/19 19K - 09/20 32K - 09/21 40K - 09/22 55K - ?? 70K - 07/24 81K - 09/25 98K', 'remarks': 'VOSA STATES 55K- 70K- 85K- 99K - SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/200f9fc0-f464-439e-8fc6-b80e4b2e8578.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117049073, 'registration': 'SL67EDP', 'account': 'MAN037', 'make': 'HYUNDAI', 'model': 'SANTA FE DIESEL ESTATE', 'derivative': '2.2 CRDi Blue Drive Premium SE 5dr [7 Seats]', 'mileage': 99982, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-10-19', 'fuel': 'Diesel', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 2199, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SL67EDP/2025-11-07/image/5dd11dab-32fe-46ef-bdf3-902d5171a77a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/10bfce8f-3edd-46e4-a6eb-5c0859a53d2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/f2720bea-52b5-4480-8863-caeef6a0eff9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/34bcc908-d49f-40da-bba0-c6f6c14b5aba_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/583ecf73-9d6a-4fa1-884e-cd3d0709197d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/7cfd2c5b-7714-43cd-8067-68afb51a5cf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/d15098f6-7d3a-493e-9992-d09c97683f9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL67EDP/2025-11-07/image/567019a8-8375-4503-9b3e-bc5c48ec78d2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 05/19 19K - 09/20 32K - 09/21 40K - 09/22 55K - ?? 70K - 07/24 81K - 09/25 98K', 'remarks': 'VOSA STATES 55K- 70K- 85K- 99K - SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/200f9fc0-f464-439e-8fc6-b80e4b2e8578.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7633a7-96be-56e7-a341-0e1f4d653838 with identifier: 117049073
2025-11-27 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7633a7-96be-56e7-a341-0e1f4d653838 with scrape type 2
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7633a7-96be-56e7-a341-0e1f4d653838 with scrape type 2
2025-11-27 19:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9e7633a7-96be-56e7-a341-0e1f4d653838, identifier: 117049073
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573893, 'registration': 'FN67FVP', 'account': 'MOT129', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL GRAND SPORT', 'derivative': '1.6 Turbo D ecoTec [136] Elite Nav 5dr', 'mileage': 90696, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-15', 'fuel': 'Diesel', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FN67FVP/2025-11-27/image/74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K, 49K, 57K, 67K, 78K, 88K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0acb4a7-0fdb-4c96-a77b-d2c5f0c03c24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573893, 'registration': 'FN67FVP', 'account': 'MOT129', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL GRAND SPORT', 'derivative': '1.6 Turbo D ecoTec [136] Elite Nav 5dr', 'mileage': 90696, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-15', 'fuel': 'Diesel', 'motExpiry': '2026-09-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FN67FVP/2025-11-27/image/74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K, 49K, 57K, 67K, 78K, 88K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0acb4a7-0fdb-4c96-a77b-d2c5f0c03c24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a with identifier: 117573893
2025-11-27 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a with scrape type 1
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117555034, 'registration': 'YK73ELN', 'account': 'VAN041', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.0 TCe 90 Evolution 5dr', 'mileage': 1, 'mileageWarranty': False, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-12-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117555034, 'registration': 'YK73ELN', 'account': 'VAN041', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.0 TCe 90 Evolution 5dr', 'mileage': 1, 'mileageWarranty': False, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-12-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910763c2-40fa-50b4-91d9-671f5d2945a7 with identifier: 117555034
2025-11-27 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910763c2-40fa-50b4-91d9-671f5d2945a7 with scrape type 1
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 910763c2-40fa-50b4-91d9-671f5d2945a7
2025-11-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 910763c2-40fa-50b4-91d9-671f5d2945a7
2025-11-27 19:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 910763c2-40fa-50b4-91d9-671f5d2945a7, identifier: 117555034
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 117508089
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508089%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Scrape type for 117508089: 0
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 116671419
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116671419%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Scrape type for 116671419: 2
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9e7633a7-96be-56e7-a341-0e1f4d653838 with identifier: 117049073
2025-11-27 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9e7633a7-96be-56e7-a341-0e1f4d653838 with identifier: 117049073
2025-11-27 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160905 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160905
2025-11-27 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9e7633a7-96be-56e7-a341-0e1f4d653838 spider: astonbarclay.gb
2025-11-27 19:02:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9e7633a7-96be-56e7-a341-0e1f4d653838 due to rule: high_mileage_for_country.json, error: 160905 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160905
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '9e7633a7-96be-56e7-a341-0e1f4d653838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SL67EDP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117049073',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'SANTA FE DIESEL ESTATE',
 'odometer': 99982,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': 'Manamanx Ltd',
 'title': 'HYUNDAI SANTA FE DIESEL ESTATE 2.2 CRDi Blue Drive Premium SE 5dr '
          '[7 Seats]',
 'transmission': 'manual',
 'trim': '2.2 CRDi Blue Drive Premium SE 5dr [7 Seats]',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049073%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Saving data for 117049073: {'auction_closing_time': 1764610200.0, 'created_time': 1762542443.079682, 'last_price_update_time': 1764270166.291419}
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117049073') HTTP/1.1" 204 0
2025-11-27 19:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 910763c2-40fa-50b4-91d9-671f5d2945a7 with identifier: 117555034
2025-11-27 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 910763c2-40fa-50b4-91d9-671f5d2945a7 with identifier: 117555034
2025-11-27 19:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 910763c2-40fa-50b4-91d9-671f5d2945a7 with identifier: 117555034 to the API
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27910763c2-40fa-50b4-91d9-671f5d2945a7%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 910763c2-40fa-50b4-91d9-671f5d2945a7: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117555034?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '910763c2-40fa-50b4-91d9-671f5d2945a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YK73ELN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117555034',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'RENAULT',
 'model': 'CLIO HATCHBACK',
 'odometer': 1,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-29',
 'seller_name': 'Vantage Motor Group',
 'title': 'RENAULT CLIO HATCHBACK 1.0 TCe 90 Evolution 5dr',
 'transmission': 'manual',
 'trim': '1.0 TCe 90 Evolution 5dr',
 'vin': None,
 'year': 2023}
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555034%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Saving data for 117555034: {'created_time': 1764270166.603718, 'last_price_update_time': 1764270166.603729, 'auction_closing_time': 1764680400.0}
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117555034') HTTP/1.1" 204 0
2025-11-27 19:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117516097?view=catalogue)
2025-11-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/X88SGD/2025-11-07/image/8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117012889?view=catalogue)
2025-11-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg?w=600 not downloaded yet
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Found listing with ID: 116989244
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116989244%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [astonbarclay.gb] INFO: Scrape type for 116989244: 2
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252Fc61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/c61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec8a910>
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252Fe46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe42790>
2025-11-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fda1210>
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252Fe53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/e53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea2aa10>
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252Fea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/ea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d2da910>
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fde97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117532070, 'registration': 'YR18FUO', 'account': 'THE109', 'make': 'MAZDA', 'model': 'MAZDA3 DIESEL HATCHBACK', 'derivative': '2.2d SE-L Nav 5dr', 'mileage': 28873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-03-27', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YR18FUO/2025-11-27/image/354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/da6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/efec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/c41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/f4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/dfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 10K, 14K, 20K, 24K, 26K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117532070, 'registration': 'YR18FUO', 'account': 'THE109', 'make': 'MAZDA', 'model': 'MAZDA3 DIESEL HATCHBACK', 'derivative': '2.2d SE-L Nav 5dr', 'mileage': 28873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-03-27', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YR18FUO/2025-11-27/image/354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/da6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/efec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/c41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/f4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/dfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 10K, 14K, 20K, 24K, 26K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc069a1-87ad-5103-af81-7b392c39aa5f with identifier: 117532070
2025-11-27 19:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc069a1-87ad-5103-af81-7b392c39aa5f with scrape type 1
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117555641, 'registration': 'YW23BJU', 'account': 'VAN040', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale 5dr', 'mileage': 1, 'mileageWarranty': False, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117555641, 'registration': 'YW23BJU', 'account': 'VAN040', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale 5dr', 'mileage': 1, 'mileageWarranty': False, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df214036-8f80-5dea-b3eb-4e6327228455 with identifier: 117555641
2025-11-27 19:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df214036-8f80-5dea-b3eb-4e6327228455 with scrape type 1
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item df214036-8f80-5dea-b3eb-4e6327228455
2025-11-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item df214036-8f80-5dea-b3eb-4e6327228455
2025-11-27 19:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: df214036-8f80-5dea-b3eb-4e6327228455, identifier: 117555641
2025-11-27 19:02:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117510413, 'registration': 'LC68JOU', 'account': 'VAN042', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 82 Feel Nav Edition 5dr', 'mileage': 50353, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-13', 'fuel': 'Petrol', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg?w=600', 'https://abimg002.imgix.net/721c13b2-e761-4d2b-8268-f764f22e9006.jpg?w=600', 'https://abimg002.imgix.net/b005a202-0508-4151-a98e-70faa76a4f0c.jpg?w=600', 'https://abimg002.imgix.net/de6a90d3-124e-4c03-86b4-2d807df54123.jpg?w=600', 'https://abimg002.imgix.net/120a7939-e621-4e00-bdcf-71f655009de7.jpg?w=600', 'https://abimg002.imgix.net/a9b7b95c-f0fa-4656-8424-7204f59946e1.jpg?w=600', 'https://abimg002.imgix.net/917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg?w=600', 'https://abimg002.imgix.net/a052f7c3-eca6-49f3-bd95-66b74e919858.jpg?w=600', 'https://abimg002.imgix.net/559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg?w=600', 'https://abimg002.imgix.net/ecd16e9b-369a-413f-a5a0-bc06e5628090.jpg?w=600', 'https://abimg002.imgix.net/2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg?w=600', 'https://abimg002.imgix.net/23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg?w=600', 'https://abimg002.imgix.net/b34becc2-f844-46fb-a985-4402fafd53f4.jpg?w=600', 'https://abimg002.imgix.net/27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 14K, 21K, 30K, 39K, 49K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117510413, 'registration': 'LC68JOU', 'account': 'VAN042', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 82 Feel Nav Edition 5dr', 'mileage': 50353, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-13', 'fuel': 'Petrol', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg?w=600', 'https://abimg002.imgix.net/721c13b2-e761-4d2b-8268-f764f22e9006.jpg?w=600', 'https://abimg002.imgix.net/b005a202-0508-4151-a98e-70faa76a4f0c.jpg?w=600', 'https://abimg002.imgix.net/de6a90d3-124e-4c03-86b4-2d807df54123.jpg?w=600', 'https://abimg002.imgix.net/120a7939-e621-4e00-bdcf-71f655009de7.jpg?w=600', 'https://abimg002.imgix.net/a9b7b95c-f0fa-4656-8424-7204f59946e1.jpg?w=600', 'https://abimg002.imgix.net/917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg?w=600', 'https://abimg002.imgix.net/a052f7c3-eca6-49f3-bd95-66b74e919858.jpg?w=600', 'https://abimg002.imgix.net/559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg?w=600', 'https://abimg002.imgix.net/ecd16e9b-369a-413f-a5a0-bc06e5628090.jpg?w=600', 'https://abimg002.imgix.net/2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg?w=600', 'https://abimg002.imgix.net/23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg?w=600', 'https://abimg002.imgix.net/b34becc2-f844-46fb-a985-4402fafd53f4.jpg?w=600', 'https://abimg002.imgix.net/27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 14K, 21K, 30K, 39K, 49K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4da9673-5b8e-5a2f-8c1a-389b5438e23a with identifier: 117510413
2025-11-27 19:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a with scrape type 1
2025-11-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg?w=600 not downloaded yet
2025-11-27 19:02:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117189741, 'registration': 'LS20EVF', 'account': 'AST003', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line X 5dr', 'mileage': 44712, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-06-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS20EVF/2025-11-21/image/55bb3d38-6a1a-4600-9365-9023d0ad9e53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/8775fd0e-f68f-47f8-a0ce-d372a0a3ead9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/a18dd180-ccb6-4a82-8947-cbbcfcb72ce2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/6fd1c91a-704e-469c-a3d0-c881d22a5bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/7f0b63f7-9175-4f27-b347-8770117cb828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/1f999467-ebc9-4e4e-a160-3087cd12f2b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/ef6ea3ab-dc55-4f85-b0eb-15bd90da1ce3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/bd0c9d2b-5edc-42f6-b695-d22cabfdf38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/61046587-c280-48d4-a6d0-1110f0f0db10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/dcc2aa36-9ada-40ee-ac31-0cfe80bb063f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 10/24 38K', 'remarks': '**NO FIRST GEAR** VOSA STATES 21K- 32K- 44K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eaaabb9c-ce3c-46a4-89d4-ca7b2b7350e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117189741, 'registration': 'LS20EVF', 'account': 'AST003', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line X 5dr', 'mileage': 44712, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-06-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS20EVF/2025-11-21/image/55bb3d38-6a1a-4600-9365-9023d0ad9e53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/8775fd0e-f68f-47f8-a0ce-d372a0a3ead9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/a18dd180-ccb6-4a82-8947-cbbcfcb72ce2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/6fd1c91a-704e-469c-a3d0-c881d22a5bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/7f0b63f7-9175-4f27-b347-8770117cb828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/1f999467-ebc9-4e4e-a160-3087cd12f2b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/ef6ea3ab-dc55-4f85-b0eb-15bd90da1ce3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/bd0c9d2b-5edc-42f6-b695-d22cabfdf38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/61046587-c280-48d4-a6d0-1110f0f0db10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/dcc2aa36-9ada-40ee-ac31-0cfe80bb063f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 10/24 38K', 'remarks': '**NO FIRST GEAR** VOSA STATES 21K- 32K- 44K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eaaabb9c-ce3c-46a4-89d4-ca7b2b7350e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741
2025-11-27 19:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d890f37-fd6f-5356-92e4-7275c95936de with scrape type 2
2025-11-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d890f37-fd6f-5356-92e4-7275c95936de with scrape type 2
2025-11-27 19:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d890f37-fd6f-5356-92e4-7275c95936de, identifier: 117189741
2025-11-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GF17HHA/2025-11-03/image/8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116894508?view=catalogue)
2025-11-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue)
2025-11-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NL68MVS/2025-11-05/image/6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116937928?view=catalogue)
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg?w=600 not downloaded yet
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252Fb2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: df214036-8f80-5dea-b3eb-4e6327228455 with identifier: 117555641
2025-11-27 19:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: df214036-8f80-5dea-b3eb-4e6327228455 with identifier: 117555641
2025-11-27 19:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: df214036-8f80-5dea-b3eb-4e6327228455 with identifier: 117555641 to the API
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27df214036-8f80-5dea-b3eb-4e6327228455%27 HTTP/1.1" 200 None
2025-11-27 19:02:48 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id df214036-8f80-5dea-b3eb-4e6327228455: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:48 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117555641?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'df214036-8f80-5dea-b3eb-4e6327228455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YW23BJU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117555641',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 1,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-17',
 'seller_name': 'Vantage Motor Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale '
          '5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale 5dr',
 'vin': None,
 'year': 2023}
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555641%27 HTTP/1.1" 200 None
2025-11-27 19:02:48 [astonbarclay.gb] INFO: Saving data for 117555641: {'created_time': 1764270168.510302, 'last_price_update_time': 1764270168.510315, 'auction_closing_time': 1764680400.0}
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117555641') HTTP/1.1" 204 0
2025-11-27 19:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741
2025-11-27 19:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741
2025-11-27 19:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741 to the API
2025-11-27 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117189741?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d890f37-fd6f-5356-92e4-7275c95936de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS20EVF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117189741',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 44712,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-19',
 'seller_name': 'TCB Group - Value',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 ST-Line X 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line X 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189741%27 HTTP/1.1" 200 None
2025-11-27 19:02:50 [astonbarclay.gb] INFO: Saving data for 117189741: {'auction_closing_time': 1764331200.0, 'created_time': 1763715708.097447, 'last_price_update_time': 1764270170.472144}
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117189741') HTTP/1.1" 204 0
2025-11-27 19:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:02:50 [astonbarclay.gb] INFO: Found listing with ID: 117288965
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288965%27 HTTP/1.1" 200 None
2025-11-27 19:02:50 [astonbarclay.gb] INFO: Scrape type for 117288965: 2
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F721c13b2-e761-4d2b-8268-f764f22e9006.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/721c13b2-e761-4d2b-8268-f764f22e9006.jpg?w=600 not downloaded yet
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540120?view=catalogue)
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg?w=600 not downloaded yet
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117175645?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117290737?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117121221?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117330721?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd6e90>
2025-11-27 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA17JVP%252F2025-11-26%252Fimage%252F3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b28762c-2bae-5102-9653-180e962825f3
2025-11-27 19:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b28762c-2bae-5102-9653-180e962825f3, skipping ID generation
2025-11-27 19:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b28762c-2bae-5102-9653-180e962825f3 with scrape type 1
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7b28762c-2bae-5102-9653-180e962825f3 from tracking dictionaries
2025-11-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b28762c-2bae-5102-9653-180e962825f3 sending to next pipeline
2025-11-27 19:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7b28762c-2bae-5102-9653-180e962825f3, identifier: 117516097
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e984e90>
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FX88SGD%252F2025-11-07%252Fimage%252F8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/X88SGD/2025-11-07/image/8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d
2025-11-27 19:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d, skipping ID generation
2025-11-27 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d with scrape type 1
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d from tracking dictionaries
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d sending to next pipeline
2025-11-27 19:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d, identifier: 117012889
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbc210>
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c348490>
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:02:51 [astonbarclay.gb] INFO: Found listing with ID: 115431227
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115431227%27 HTTP/1.1" 200 None
2025-11-27 19:02:51 [astonbarclay.gb] INFO: Scrape type for 115431227: 2
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fda6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/da6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb005a202-0508-4151-a98e-70faa76a4f0c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b005a202-0508-4151-a98e-70faa76a4f0c.jpg?w=600 not downloaded yet
2025-11-27 19:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097
2025-11-27 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097
2025-11-27 19:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7b28762c-2bae-5102-9653-180e962825f3 with identifier: 117516097 to the API
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '7b28762c-2bae-5102-9653-180e962825f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA17JVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117516097',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q3 ESTATE SPECIAL EDITIONS',
 'odometer': 69777,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39093,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/3c178bc2-8dc9-4fd0-9c06-50c2c7f51772_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42548,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/90396b07-446f-45e4-abfb-bf2e19115bf7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40793,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/efc83eb9-b0d8-44df-ba6a-a2a4f6e7ce57_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38795,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/113d529b-5438-4bcd-aab5-3a1374961536_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25414,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2c819e7e-dacc-409f-8c51-aca980a67758_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52974,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/6f3e9c4c-add3-41be-94f1-28d2fac80c6d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45411,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/040b6195-d655-4f28-91d8-15719663b4fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44969,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/718bcf6f-28d6-4099-bc6a-2b0d80b9b44b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b28762c-2bae-5102-9653-180e962825f3/7b28762c-2bae-5102-9653-180e962825f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48909,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA17JVP/2025-11-26/image/2b15990d-2535-4bf4-89d1-94d98d87dea5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': 'UKCGR - Trade',
 'title': 'AUDI Q3 ESTATE SPECIAL EDITIONS 2.0 TDI [184] Quattro Black Edition '
          '5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI [184] Quattro Black Edition 5dr S Tronic',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516097%27 HTTP/1.1" 200 None
2025-11-27 19:02:52 [astonbarclay.gb] INFO: Saving data for 117516097: {'created_time': 1764270172.470739, 'last_price_update_time': 1764270172.470751, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117516097') HTTP/1.1" 204 0
2025-11-27 19:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d with identifier: 117012889
2025-11-27 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d with identifier: 117012889
2025-11-27 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139262 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139262
2025-11-27 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d spider: astonbarclay.gb
2025-11-27 19:02:52 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3c172d14-a3f6-5aa6-a12a-81304ab1ee8d due to rule: high_mileage_for_make.json, error: 139262 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    139262
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '3c172d14-a3f6-5aa6-a12a-81304ab1ee8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'X88SGD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117012889',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 86534,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36862,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/8072302d-31f0-43e3-b58c-e28bd69cae2d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39328,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/658c8611-09f4-4425-b40b-fc6ce2a49e41_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37513,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/71f84750-963f-404d-9087-7f3d8d2c0e19_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37855,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/346e126b-923b-4010-91dd-6055c012aeb1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49468,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/ca8bae82-d70a-4b97-8804-317fe8309b22_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50380,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/79552ac7-f3bd-4a31-a731-1e6d90f4e18c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38156,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/2660be8d-08f7-45d3-80ac-58001333d5d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44498,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/f1d1bdf5-8e7b-4cf6-9cf2-7aaad1e97da0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c172d14-a3f6-5aa6-a12a-81304ab1ee8d/3c172d14-a3f6-5aa6-a12a-81304ab1ee8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39238,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/X88SGD/2025-11-07/image/3d4cb984-d4e2-4371-a4f2-2c85c5b09f23_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-22',
 'seller_name': 'Mann Island Finance',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 HSE Dynamic '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2018}
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117012889%27 HTTP/1.1" 200 None
2025-11-27 19:02:52 [astonbarclay.gb] INFO: Saving data for 117012889: {'created_time': 1764270172.729774, 'last_price_update_time': 1764270172.729785, 'auction_closing_time': 1764583200.0}
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117012889') HTTP/1.1" 204 0
2025-11-27 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb027d0>
2025-11-27 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGF17HHA%252F2025-11-03%252Fimage%252F8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GF17HHA/2025-11-03/image/8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19ec35d1-1879-5eba-be8a-db9c6a19989b
2025-11-27 19:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19ec35d1-1879-5eba-be8a-db9c6a19989b, skipping ID generation
2025-11-27 19:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ec35d1-1879-5eba-be8a-db9c6a19989b with scrape type 1
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 19ec35d1-1879-5eba-be8a-db9c6a19989b from tracking dictionaries
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19ec35d1-1879-5eba-be8a-db9c6a19989b sending to next pipeline
2025-11-27 19:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 19ec35d1-1879-5eba-be8a-db9c6a19989b, identifier: 116894508
2025-11-27 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eceb5d0>
2025-11-27 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM21ZBZ%252F2025-11-07%252Fimage%252F3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41bf6ac4-f348-5706-8fe9-40b48433019d
2025-11-27 19:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41bf6ac4-f348-5706-8fe9-40b48433019d, skipping ID generation
2025-11-27 19:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41bf6ac4-f348-5706-8fe9-40b48433019d with scrape type 1
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 41bf6ac4-f348-5706-8fe9-40b48433019d from tracking dictionaries
2025-11-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41bf6ac4-f348-5706-8fe9-40b48433019d sending to next pipeline
2025-11-27 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 41bf6ac4-f348-5706-8fe9-40b48433019d, identifier: 116988307
2025-11-27 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb90ed0>
2025-11-27 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNL68MVS%252F2025-11-05%252Fimage%252F6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NL68MVS/2025-11-05/image/6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62ba71b6-6590-54ae-a30f-a26ea81b9533
2025-11-27 19:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62ba71b6-6590-54ae-a30f-a26ea81b9533, skipping ID generation
2025-11-27 19:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ba71b6-6590-54ae-a30f-a26ea81b9533 with scrape type 1
2025-11-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 62ba71b6-6590-54ae-a30f-a26ea81b9533 from tracking dictionaries
2025-11-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62ba71b6-6590-54ae-a30f-a26ea81b9533 sending to next pipeline
2025-11-27 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 62ba71b6-6590-54ae-a30f-a26ea81b9533, identifier: 116937928
2025-11-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg?w=600 not downloaded yet
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252Fb2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 19ec35d1-1879-5eba-be8a-db9c6a19989b with identifier: 116894508
2025-11-27 19:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 19ec35d1-1879-5eba-be8a-db9c6a19989b with identifier: 116894508
2025-11-27 19:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 19ec35d1-1879-5eba-be8a-db9c6a19989b with identifier: 116894508 to the API
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GF17HHA/2025-11-03/image/8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '19ec35d1-1879-5eba-be8a-db9c6a19989b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF17HHA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116894508',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X6 DIESEL ESTATE',
 'odometer': 79981,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34593,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/8181ba6e-55cb-40e2-826d-81558dac56b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34234,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/e53cd810-ee74-470b-8440-699392e0ae2e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36604,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/fcbe402a-d5fe-456f-b18d-ecb211ab5fd6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32851,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/d3ba50ad-1213-472b-9ec8-78135e9d4cc7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29994,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/ef8a0a61-c20e-4143-ad5e-0053d7b155d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22211,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/f7e18a0b-f4ee-42bc-8b05-ffea3b217aad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53618,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/9eafd015-99d7-4f8e-9d59-ac57d1372e6a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40376,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/bea3ef8b-469c-4654-b5e3-24d8357b0a76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39777,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/1d934e18-1a3b-4743-a2af-bb54a95261c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19ec35d1-1879-5eba-be8a-db9c6a19989b/19ec35d1-1879-5eba-be8a-db9c6a19989b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31220,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GF17HHA/2025-11-03/image/a40afb31-7e39-402a-8b7c-337973ae6bc2_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': 'Mann Island Finance',
 'title': 'BMW X6 DIESEL ESTATE xDrive M50d 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive M50d 5dr Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116894508%27 HTTP/1.1" 200 None
2025-11-27 19:02:54 [astonbarclay.gb] INFO: Saving data for 116894508: {'created_time': 1764270174.745979, 'last_price_update_time': 1764270174.745989, 'auction_closing_time': 1764583200.0}
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116894508') HTTP/1.1" 204 0
2025-11-27 19:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 41bf6ac4-f348-5706-8fe9-40b48433019d with identifier: 116988307
2025-11-27 19:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 41bf6ac4-f348-5706-8fe9-40b48433019d with identifier: 116988307
2025-11-27 19:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175084 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175084
2025-11-27 19:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 41bf6ac4-f348-5706-8fe9-40b48433019d spider: astonbarclay.gb
2025-11-27 19:02:54 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 41bf6ac4-f348-5706-8fe9-40b48433019d due to rule: high_mileage_for_country.json, error: 175084 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175084
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '41bf6ac4-f348-5706-8fe9-40b48433019d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WM21ZBZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988307',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 108793,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/3625fed7-66b4-49eb-9830-e1f5c29a7c4f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33981,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/5772a353-a805-4a25-834c-20b8e855790f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33685,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/c198f057-2ea1-4e13-91cf-652f8b5681ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32946,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/e1003420-aabd-4e07-a698-bb4709dfe4ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42124,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/39882e16-7fc3-4c02-a7aa-e24c21d58325_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47375,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/688420e1-9c45-407f-8ef3-b4a0492e04df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34409,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/9210afa1-f83e-4f6a-a42d-62cb5c51b8cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39520,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/fdc72ec3-c2f7-4a79-8de1-a5828e7ed655_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf6ac4-f348-5706-8fe9-40b48433019d/41bf6ac4-f348-5706-8fe9-40b48433019d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40817,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM21ZBZ/2025-11-07/image/ae28aa26-16c5-4477-ac86-bf81537ef38c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': 'Mann Island Finance',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A250e AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A250e AMG Line 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2025-11-27 19:02:54 [astonbarclay.gb] INFO: Saving data for 116988307: {'created_time': 1764270174.988097, 'last_price_update_time': 1764270174.988108, 'auction_closing_time': 1764583200.0}
2025-11-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116988307') HTTP/1.1" 204 0
2025-11-27 19:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 62ba71b6-6590-54ae-a30f-a26ea81b9533 with identifier: 116937928
2025-11-27 19:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 62ba71b6-6590-54ae-a30f-a26ea81b9533 with identifier: 116937928
2025-11-27 19:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 62ba71b6-6590-54ae-a30f-a26ea81b9533 with identifier: 116937928 to the API
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NL68MVS/2025-11-05/image/6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '62ba71b6-6590-54ae-a30f-a26ea81b9533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL68MVS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116937928',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS DIESEL HATCHBACK',
 'odometer': 49548,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30534,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/6b4901f9-7b9f-4110-8c95-33360d61f6df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29925,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/ea213cb2-716b-4c62-bed1-9ca9f6ce6a35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32012,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b08829ca-3e1c-4af9-b9bb-4e6ba526dbbc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29692,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/971d659e-1929-4c24-b2eb-e510abe217e1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66112,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/63064870-f6e6-4d3a-a96d-7827d3dad361_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50786,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/b9b5d122-4d30-47cc-ae89-6dc72d182fe6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39527,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/f1b4e7a2-ac51-44e3-9797-bea2606d1f88_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40033,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/9ea6d2c4-d4d8-475b-be42-27edc46e1490_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ba71b6-6590-54ae-a30f-a26ea81b9533/62ba71b6-6590-54ae-a30f-a26ea81b9533_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40432,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NL68MVS/2025-11-05/image/c0ba9d7e-d69f-4938-b14d-5b81ceb6a65d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-29',
 'seller_name': 'Mann Island Finance',
 'title': 'MERCEDES-BENZ A CLASS DIESEL HATCHBACK A180d AMG Line Executive 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'A180d AMG Line Executive 5dr Auto',
 'vin': None,
 'year': 2018}
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116937928%27 HTTP/1.1" 200 None
2025-11-27 19:02:55 [astonbarclay.gb] INFO: Saving data for 116937928: {'created_time': 1764270175.443178, 'last_price_update_time': 1764270175.443189, 'auction_closing_time': 1764583200.0}
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116937928') HTTP/1.1" 204 0
2025-11-27 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:02:55 [astonbarclay.gb] INFO: Found listing with ID: 117424411
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424411%27 HTTP/1.1" 200 None
2025-11-27 19:02:55 [astonbarclay.gb] INFO: Scrape type for 117424411: 0
2025-11-27 19:02:55 [astonbarclay.gb] INFO: Found listing with ID: 117400527
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400527%27 HTTP/1.1" 200 None
2025-11-27 19:02:55 [astonbarclay.gb] INFO: Scrape type for 117400527: 1
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fefec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/efec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fde6a90d3-124e-4c03-86b4-2d807df54123.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/de6a90d3-124e-4c03-86b4-2d807df54123.jpg?w=600 not downloaded yet
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe3a510>
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252Fa2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb85e10>
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252Fe67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80ba50>
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e848dd0>
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY17CNK%252F2025-11-27%252Fimage%252F243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c
2025-11-27 19:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 628e0c70-d61b-5045-bdcf-a4db2791dc5c, skipping ID generation
2025-11-27 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c with scrape type 1
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 628e0c70-d61b-5045-bdcf-a4db2791dc5c from tracking dictionaries
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 628e0c70-d61b-5045-bdcf-a4db2791dc5c sending to next pipeline
2025-11-27 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 628e0c70-d61b-5045-bdcf-a4db2791dc5c, identifier: 117540120
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117175645, 'registration': 'LD16ZGG', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna [Non-Panoramic] 5dr', 'mileage': 64401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-25', 'fuel': 'Petrol', 'motExpiry': '2025-10-10', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2de7a411-c89e-4f37-b214-f53fb39b1c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/9e0af537-a9dd-4ab6-b0a8-35cf2074e543_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/4c651648-d64d-46d8-8ce3-c77b30c5846d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/af9119d4-91ef-4a95-a598-0b11d053c7ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/1e338ac0-373f-455f-b38d-1627f870515e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/980eb039-974d-4d41-b953-5e50b48b01fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2566840e-0325-4b37-a0dd-2528a705a2c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/814f93be-680e-4888-abe8-d09aadff9555_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/98702116-45ea-4f43-965d-9a2f70caa6fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/41dba378-48b3-48ae-b329-4a97fadf1309_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 3K 02/18 12K 02/19 22K 02/20 29K 03/21 33K 06/22 42K 02/25 52K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ed834d5-661e-4318-a6e2-96fee118c244.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117175645, 'registration': 'LD16ZGG', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna [Non-Panoramic] 5dr', 'mileage': 64401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-25', 'fuel': 'Petrol', 'motExpiry': '2025-10-10', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2de7a411-c89e-4f37-b214-f53fb39b1c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/9e0af537-a9dd-4ab6-b0a8-35cf2074e543_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/4c651648-d64d-46d8-8ce3-c77b30c5846d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/af9119d4-91ef-4a95-a598-0b11d053c7ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/1e338ac0-373f-455f-b38d-1627f870515e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/980eb039-974d-4d41-b953-5e50b48b01fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2566840e-0325-4b37-a0dd-2528a705a2c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/814f93be-680e-4888-abe8-d09aadff9555_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/98702116-45ea-4f43-965d-9a2f70caa6fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/41dba378-48b3-48ae-b329-4a97fadf1309_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 3K 02/18 12K 02/19 22K 02/20 29K 03/21 33K 06/22 42K 02/25 52K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ed834d5-661e-4318-a6e2-96fee118c244.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645
2025-11-27 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with scrape type 2
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with scrape type 2
2025-11-27 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8, identifier: 117175645
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117290737, 'registration': 'PX18WGC', 'account': 'HYA001', 'make': 'JAGUAR', 'model': 'E-PACE DIESEL ESTATE', 'derivative': '2.0d 5dr 2WD', 'mileage': 86361, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PX18WGC/2025-11-18/image/403ecea7-d6f8-44d7-9379-4722bceebb11_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/cc47f4b0-83a0-49f5-9dd5-3c2a2e9d2073_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/68eb2f5a-1c1f-4654-8892-024e1ef4c608_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/141d93f9-c761-48e4-b3f3-5788eca93675_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/2fb23b14-3e4e-4b45-ac80-56b854a16a55_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/c9d4bc5b-390c-48de-a1e1-686afa40b1cf_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book S/P @ 11/19 22K 10/21 41K INV 10/23 66K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07429854-a35e-4b6b-9e24-f18197e37570.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117290737, 'registration': 'PX18WGC', 'account': 'HYA001', 'make': 'JAGUAR', 'model': 'E-PACE DIESEL ESTATE', 'derivative': '2.0d 5dr 2WD', 'mileage': 86361, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-03-29', 'fuel': 'Diesel', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PX18WGC/2025-11-18/image/403ecea7-d6f8-44d7-9379-4722bceebb11_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/cc47f4b0-83a0-49f5-9dd5-3c2a2e9d2073_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/68eb2f5a-1c1f-4654-8892-024e1ef4c608_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/141d93f9-c761-48e4-b3f3-5788eca93675_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/2fb23b14-3e4e-4b45-ac80-56b854a16a55_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX18WGC/2025-11-18/image/c9d4bc5b-390c-48de-a1e1-686afa40b1cf_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book S/P @ 11/19 22K 10/21 41K INV 10/23 66K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/07429854-a35e-4b6b-9e24-f18197e37570.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc70b47d-a24e-55d9-bb64-775ef5fccff4 with identifier: 117290737
2025-11-27 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc70b47d-a24e-55d9-bb64-775ef5fccff4 with scrape type 2
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc70b47d-a24e-55d9-bb64-775ef5fccff4 with scrape type 2
2025-11-27 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cc70b47d-a24e-55d9-bb64-775ef5fccff4, identifier: 117290737
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117121221, 'registration': 'YP22XFK', 'account': 'THE142', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto', 'mileage': 17611, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-14', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP22XFK/2025-11-13/image/362d1d7a-681a-409b-be40-cede1246b497_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/eee466dd-05e9-41cb-9b5a-9bdd5430f1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/916971f4-1ffd-483f-993c-78f680fd1378_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/abe7aa43-786c-4cc6-aa3a-026d55dda66c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/73453dfe-b546-4b06-ae99-797d5126eb19_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18aa6029-c39d-4c13-b389-8afcc10c3104_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18341d90-6072-48ca-993a-d491aec12c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/5008c607-30e4-477c-ac47-7ef11f594f00_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/2a9b0bac-056e-4d9d-b7aa-1375b5405bdc_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/23-10K, 06/24-14K, 06/25-17K', 'remarks': 'STOLEN/RECOVERED - Damage is front end and minor dents/scratches VOSA STATES 17K', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0e0d0e3-cbb0-43f4-97b4-3b753e431cb8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117121221, 'registration': 'YP22XFK', 'account': 'THE142', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto', 'mileage': 17611, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-14', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP22XFK/2025-11-13/image/362d1d7a-681a-409b-be40-cede1246b497_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/eee466dd-05e9-41cb-9b5a-9bdd5430f1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/916971f4-1ffd-483f-993c-78f680fd1378_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/abe7aa43-786c-4cc6-aa3a-026d55dda66c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/73453dfe-b546-4b06-ae99-797d5126eb19_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18aa6029-c39d-4c13-b389-8afcc10c3104_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18341d90-6072-48ca-993a-d491aec12c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/5008c607-30e4-477c-ac47-7ef11f594f00_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/2a9b0bac-056e-4d9d-b7aa-1375b5405bdc_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/23-10K, 06/24-14K, 06/25-17K', 'remarks': 'STOLEN/RECOVERED - Damage is front end and minor dents/scratches VOSA STATES 17K', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0e0d0e3-cbb0-43f4-97b4-3b753e431cb8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221
2025-11-27 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d07d2e4-2037-54bb-880e-739d9b317cff with scrape type 2
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d07d2e4-2037-54bb-880e-739d9b317cff with scrape type 2
2025-11-27 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d07d2e4-2037-54bb-880e-739d9b317cff, identifier: 117121221
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117330721, 'registration': 'ND17YCN', 'account': 'ILI003', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 91094, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ND17YCN/2025-11-20/image/fba5521c-a07b-410b-9cad-9cd6a2f6a76a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/6e8c4a21-f010-4247-997d-e18432798f41_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/494e77fe-8b5a-45dd-bc62-a99cf9dd1778_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/b566f82c-67b4-408c-9913-5dcd749ca111_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/ab9e97ba-f66f-4030-b991-5e5e63ea84a0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 02/24 69K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89992523-6768-44fe-804d-2941601b85b2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117330721, 'registration': 'ND17YCN', 'account': 'ILI003', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 91094, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ND17YCN/2025-11-20/image/fba5521c-a07b-410b-9cad-9cd6a2f6a76a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/6e8c4a21-f010-4247-997d-e18432798f41_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/494e77fe-8b5a-45dd-bc62-a99cf9dd1778_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/b566f82c-67b4-408c-9913-5dcd749ca111_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/ab9e97ba-f66f-4030-b991-5e5e63ea84a0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 02/24 69K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89992523-6768-44fe-804d-2941601b85b2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 with identifier: 117330721
2025-11-27 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d555d4-2de3-57f4-ab25-aef6992f84f8 with scrape type 2
2025-11-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2d555d4-2de3-57f4-ab25-aef6992f84f8 with scrape type 2
2025-11-27 19:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2d555d4-2de3-57f4-ab25-aef6992f84f8, identifier: 117330721
2025-11-27 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg?w=600 not downloaded yet
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 628e0c70-d61b-5045-bdcf-a4db2791dc5c with identifier: 117540120
2025-11-27 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 628e0c70-d61b-5045-bdcf-a4db2791dc5c with identifier: 117540120
2025-11-27 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 10, 'seller_name': 'ukcgr - select', 'price_includes_vat': False, 'title': 'land rover discovery sport diesel sw 2.0 td4 180 se tech 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery sport diesel sw', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 129273, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117540120', 'expiration_date': '2025-12-01t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0 td4 180 se tech 5dr auto', 'license_plate': 'gy17cnk', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 139, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '628e0c70-d61b-5045-bdcf-a4db2791dc5c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40153}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39717}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40154}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34377}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43197}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30153}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48402}], 'current_year_diff': 8, 'age_in_months': 103, 'make_model': 'land rover discovery sport diesel sw', 'sanitized_make': 'landrover', 'odometer_in_km': 208044}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 103,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-01t17:30:00z',
     'fuel_type': 'diesel',
     'id': '628e0c70-d61b-5045-bdcf-a4db2791dc5c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gy17cnk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117540120',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'land rover',
     'make_model': 'land rover discovery sport diesel sw',
     'model': 'discovery sport diesel sw',
     'odometer': 129273,
     'odometer_in_km': 208044,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40153,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39717,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40154,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34377,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43197,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30153,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51671,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45375,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47872,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48402,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-29',
     'sanitized_make': 'landrover',
     'seller_name': 'ukcgr - select',
     'title': 'land rover discovery sport diesel sw 2.0 td4 180 se tech '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '2.0 td4 180 se tech 5dr auto',
     'vin': None,
     'year': 2017}
2025-11-27 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 628e0c70-d61b-5045-bdcf-a4db2791dc5c spider: astonbarclay.gb
2025-11-27 19:02:57 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 628e0c70-d61b-5045-bdcf-a4db2791dc5c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 10, 'seller_name': 'ukcgr - select', 'price_includes_vat': False, 'title': 'land rover discovery sport diesel sw 2.0 td4 180 se tech 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery sport diesel sw', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 129273, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117540120', 'expiration_date': '2025-12-01t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0 td4 180 se tech 5dr auto', 'license_plate': 'gy17cnk', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 139, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '628e0c70-d61b-5045-bdcf-a4db2791dc5c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40153}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39717}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40154}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34377}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 43197}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30153}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48402}], 'current_year_diff': 8, 'age_in_months': 103, 'make_model': 'land rover discovery sport diesel sw', 'sanitized_make': 'landrover', 'odometer_in_km': 208044}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 103,
     'auction_title': '',
     'c_o_2_emission_value': 139,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-01t17:30:00z',
     'fuel_type': 'diesel',
     'id': '628e0c70-d61b-5045-bdcf-a4db2791dc5c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gy17cnk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117540120',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'land rover',
     'make_model': 'land rover discovery sport diesel sw',
     'model': 'discovery sport diesel sw',
     'odometer': 129273,
     'odometer_in_km': 208044,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40153,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39717,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40154,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34377,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43197,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30153,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51671,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45375,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47872,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48402,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-29',
     'sanitized_make': 'landrover',
     'seller_name': 'ukcgr - select',
     'title': 'land rover discovery sport diesel sw 2.0 td4 180 se tech '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '2.0 td4 180 se tech 5dr auto',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '628e0c70-d61b-5045-bdcf-a4db2791dc5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY17CNK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117540120',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 129273,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40153,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/243ec392-fbaa-4917-8994-a274732349e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39717,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/a2cee4ad-4ffa-45ef-bf21-649113ff11a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40154,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/de97f1e6-1a03-4801-b96e-19be60cd65c0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34377,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/930e4be5-f59a-4748-9212-b838af4a4b28_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43197,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/faef7226-741c-46e5-9231-8848bc4650bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30153,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/fde918f9-912f-4e9a-8829-edaba15a3d85_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51671,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/31e2cef6-718a-4f78-8c54-c6ead9084c14_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45375,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/5fb858a5-0899-4590-a4d3-9abd26f13306_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47872,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/c7649fc4-206e-4e92-a538-fbcf45698d2d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628e0c70-d61b-5045-bdcf-a4db2791dc5c/628e0c70-d61b-5045-bdcf-a4db2791dc5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48402,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY17CNK/2025-11-27/image/ed54c84a-fc0a-4e8c-a47d-57fe59534107_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': 'UKCGR - Select',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 SE Tech 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 SE Tech 5dr Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540120%27 HTTP/1.1" 200 None
2025-11-27 19:02:57 [astonbarclay.gb] INFO: Saving data for 117540120: {'created_time': 1764270177.318602, 'last_price_update_time': 1764270177.318612, 'auction_closing_time': 1764610200.0}
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117540120') HTTP/1.1" 204 0
2025-11-27 19:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645
2025-11-27 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645
2025-11-27 19:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645 to the API
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277dd6abaa-6062-5fec-a9ac-3d67d29f12c8%27 HTTP/1.1" 200 None
2025-11-27 19:02:57 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117175645?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7dd6abaa-6062-5fec-a9ac-3d67d29f12c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD16ZGG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117175645',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 64401,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-25',
 'seller_name': 'Wilsons',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T Tekna [Non-Panoramic] 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna [Non-Panoramic] 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175645%27 HTTP/1.1" 200 None
2025-11-27 19:02:57 [astonbarclay.gb] INFO: Saving data for 117175645: {'auction_closing_time': 1764666000.0, 'created_time': 1763146924.333359, 'last_price_update_time': 1764270177.627191}
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117175645') HTTP/1.1" 204 0
2025-11-27 19:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cc70b47d-a24e-55d9-bb64-775ef5fccff4 with identifier: 117290737
2025-11-27 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cc70b47d-a24e-55d9-bb64-775ef5fccff4 with identifier: 117290737
2025-11-27 19:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cc70b47d-a24e-55d9-bb64-775ef5fccff4 with identifier: 117290737 to the API
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117290737?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cc70b47d-a24e-55d9-bb64-775ef5fccff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PX18WGC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117290737',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'JAGUAR',
 'model': 'E-PACE DIESEL ESTATE',
 'odometer': 86361,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': 'Local Dealer Group',
 'title': 'JAGUAR E-PACE DIESEL ESTATE 2.0d 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0d 5dr 2WD',
 'vin': None,
 'year': 2018}
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290737%27 HTTP/1.1" 200 None
2025-11-27 19:02:57 [astonbarclay.gb] INFO: Saving data for 117290737: {'auction_closing_time': 1764666000.0, 'created_time': 1763492457.798856, 'last_price_update_time': 1764270177.961815}
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117290737') HTTP/1.1" 204 0
2025-11-27 19:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221
2025-11-27 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221
2025-11-27 19:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221 to the API
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270d07d2e4-2037-54bb-880e-739d9b317cff%27 HTTP/1.1" 200 None
2025-11-27 19:02:58 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0d07d2e4-2037-54bb-880e-739d9b317cff: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:02:57 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117121221?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d07d2e4-2037-54bb-880e-739d9b317cff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP22XFK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117121221',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SUZUKI',
 'model': 'VITARA ESTATE',
 'odometer': 17611,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seller_name': 'Auction Plus',
 'title': 'SUZUKI VITARA ESTATE 1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121221%27 HTTP/1.1" 200 None
2025-11-27 19:02:58 [astonbarclay.gb] INFO: Saving data for 117121221: {'auction_closing_time': 1764331200.0, 'created_time': 1762974198.800817, 'last_price_update_time': 1764270178.257656}
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117121221') HTTP/1.1" 204 0
2025-11-27 19:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 with identifier: 117330721
2025-11-27 19:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 with identifier: 117330721
2025-11-27 19:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146601 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146601
2025-11-27 19:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 spider: astonbarclay.gb
2025-11-27 19:02:58 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c2d555d4-2de3-57f4-ab25-aef6992f84f8 due to rule: high_mileage_for_make.json, error: 146601 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146601
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c2d555d4-2de3-57f4-ab25-aef6992f84f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ND17YCN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117330721',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'PEUGEOT',
 'model': '3008 ESTATE',
 'odometer': 91094,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': 'Local Dealer Group',
 'title': 'PEUGEOT 3008 ESTATE 1.2 PureTech Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 5dr',
 'vin': None,
 'year': 2017}
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117330721%27 HTTP/1.1" 200 None
2025-11-27 19:02:58 [astonbarclay.gb] INFO: Saving data for 117330721: {'auction_closing_time': 1764666000.0, 'created_time': 1763578955.378365, 'last_price_update_time': 1764270178.482592}
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117330721') HTTP/1.1" 204 0
2025-11-27 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:02:58 [astonbarclay.gb] INFO: Found listing with ID: 117400496
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400496%27 HTTP/1.1" 200 None
2025-11-27 19:02:58 [astonbarclay.gb] INFO: Scrape type for 117400496: 1
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fc41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/c41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F120a7939-e621-4e00-bdcf-71f655009de7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/120a7939-e621-4e00-bdcf-71f655009de7.jpg?w=600 not downloaded yet
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbd550>
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e851dd0>
2025-11-27 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F963ad14f-f915-40ef-befc-03303fe17d82.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/963ad14f-f915-40ef-befc-03303fe17d82.jpg?w=600 not downloaded yet
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252Fb9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d1e3650>
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 117459005
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459005%27 HTTP/1.1" 200 None
2025-11-27 19:02:59 [astonbarclay.gb] INFO: Scrape type for 117459005: 0
2025-11-27 19:02:59 [astonbarclay.gb] INFO: Found listing with ID: 117451351
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451351%27 HTTP/1.1" 200 None
2025-11-27 19:02:59 [astonbarclay.gb] INFO: Scrape type for 117451351: 2
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Ff4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/f4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa9b7b95c-f0fa-4656-8424-7204f59946e1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a9b7b95c-f0fa-4656-8424-7204f59946e1.jpg?w=600 not downloaded yet
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9efb10>
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252Fb2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg?w=600 saved to cache
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue)
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec41550>
2025-11-27 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fea7910>
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/efec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117426088
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426088%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117426088: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117488496
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488496%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117488496: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117498338
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498338%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117498338: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117498763
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498763%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117498763: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117494253
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117494253%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117494253: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117535309
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117535309%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117535309: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117493567
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493567%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117493567: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117492284
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492284%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117492284: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117576494
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576494%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117576494: 1
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fdfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/dfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg?w=600 not downloaded yet
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1c310>
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue)
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117376148
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117376148%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117376148: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117483520
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117483520%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117483520: 0
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Found listing with ID: 117576544
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576544%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [astonbarclay.gb] INFO: Scrape type for 117576544: 1
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa052f7c3-eca6-49f3-bd95-66b74e919858.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a052f7c3-eca6-49f3-bd95-66b74e919858.jpg?w=600 not downloaded yet
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116671419?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117121214?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117288965?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdcbc10>
2025-11-27 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg?w=600 saved to cache
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116994676?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117242983?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea45d50>
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252Fb2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea07950>
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fefec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/efec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue)
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/721c13b2-e761-4d2b-8268-f764f22e9006.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a9b7b95c-f0fa-4656-8424-7204f59946e1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:01 [astonbarclay.gb] INFO: Found listing with ID: 117537448
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537448%27 HTTP/1.1" 200 None
2025-11-27 19:03:01 [astonbarclay.gb] INFO: Scrape type for 117537448: 0
2025-11-27 19:03:01 [astonbarclay.gb] INFO: Found listing with ID: 117536984
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536984%27 HTTP/1.1" 200 None
2025-11-27 19:03:01 [astonbarclay.gb] INFO: Scrape type for 117536984: 1
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg?w=600 not downloaded yet
2025-11-27 19:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/f4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec24510>
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb8790>
2025-11-27 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg?w=600 saved to cache
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec27f50>
2025-11-27 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg?w=600 saved to cache
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116671419, 'registration': 'YP68FOJ', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.6 DiG-T N-Connecta 5dr [7 Seat]', 'mileage': 83805, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/153da7f6-451b-4b03-822c-b360dbd9b03b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8950cb37-a787-4352-9b91-2ec5f8239e6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/904e9e85-e271-4265-81de-532b1b6b440f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/bf6d2300-f723-4523-a40e-70b1f16d019a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/73aa14aa-2adf-4e99-b622-a01b3f78ad70_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/7c6c5ac7-0e78-476a-9a1e-8871ed3fc2a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/993f8248-d8ad-4196-8e73-e5a4d070a5a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/22c4baea-77d1-495a-b10f-2cb3f7f8cda1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8ca6054f-ba2d-457c-96de-4084cf37fb14_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/5fcd7af8-b5b7-4823-b5ad-abd6ff5d3631_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/a49b2131-ff5c-41c0-90bd-e0a00085baeb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/19 17K 01/21 18K / INV 01/22 37K 10/22 44K 05/25 79K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/743f4e48-3abd-4d79-9e66-f58b5b493675.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116671419, 'registration': 'YP68FOJ', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.6 DiG-T N-Connecta 5dr [7 Seat]', 'mileage': 83805, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/153da7f6-451b-4b03-822c-b360dbd9b03b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8950cb37-a787-4352-9b91-2ec5f8239e6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/904e9e85-e271-4265-81de-532b1b6b440f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/bf6d2300-f723-4523-a40e-70b1f16d019a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/73aa14aa-2adf-4e99-b622-a01b3f78ad70_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/7c6c5ac7-0e78-476a-9a1e-8871ed3fc2a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/993f8248-d8ad-4196-8e73-e5a4d070a5a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/22c4baea-77d1-495a-b10f-2cb3f7f8cda1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8ca6054f-ba2d-457c-96de-4084cf37fb14_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/5fcd7af8-b5b7-4823-b5ad-abd6ff5d3631_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/a49b2131-ff5c-41c0-90bd-e0a00085baeb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/19 17K 01/21 18K / INV 01/22 37K 10/22 44K 05/25 79K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/743f4e48-3abd-4d79-9e66-f58b5b493675.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419
2025-11-27 19:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc2fab3-cfaf-5074-af7f-c002ab916246 with scrape type 2
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc2fab3-cfaf-5074-af7f-c002ab916246 with scrape type 2
2025-11-27 19:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9bc2fab3-cfaf-5074-af7f-c002ab916246, identifier: 116671419
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117121214, 'registration': 'AV18ODA', 'account': 'MOT075', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI EVO SE 5dr', 'mileage': 74568, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-02', 'fuel': 'Petrol', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0701752-17d0-4bc1-9788-9e0a68c38bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0f51b97-a81f-4d9e-a642-6f24ee007b7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/6336eef9-deae-4221-bcfa-5f16e7e89d86_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/0b2ab386-9169-49f6-bc58-ad8b4fc27b41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/2649305c-4cc3-4ebf-aa5a-e4e7e779fb94_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/852b5b71-4b00-4dc7-b9df-2063654efe8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/72b6a836-b28d-4536-8472-97a25fcb6551_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/129f2d66-c37d-4801-8322-2c099f660da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b5fd96f7-1cb0-4407-ac11-f0f50a113fa4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/21 18K 02/25 59K / INV 12/20 14K 11/22 24K 02/24 41K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b2e06b5-6b67-4e33-a793-0c71467d9359.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117121214, 'registration': 'AV18ODA', 'account': 'MOT075', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI EVO SE 5dr', 'mileage': 74568, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-02', 'fuel': 'Petrol', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0701752-17d0-4bc1-9788-9e0a68c38bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0f51b97-a81f-4d9e-a642-6f24ee007b7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/6336eef9-deae-4221-bcfa-5f16e7e89d86_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/0b2ab386-9169-49f6-bc58-ad8b4fc27b41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/2649305c-4cc3-4ebf-aa5a-e4e7e779fb94_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/852b5b71-4b00-4dc7-b9df-2063654efe8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/72b6a836-b28d-4536-8472-97a25fcb6551_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/129f2d66-c37d-4801-8322-2c099f660da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b5fd96f7-1cb0-4407-ac11-f0f50a113fa4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/21 18K 02/25 59K / INV 12/20 14K 11/22 24K 02/24 41K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b2e06b5-6b67-4e33-a793-0c71467d9359.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214
2025-11-27 19:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b2dd90-e09f-5942-b237-c795adb5ae40 with scrape type 2
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78b2dd90-e09f-5942-b237-c795adb5ae40 with scrape type 2
2025-11-27 19:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 78b2dd90-e09f-5942-b237-c795adb5ae40, identifier: 117121214
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117288965, 'registration': 'EY19NTD', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T N-Connecta 5dr', 'mileage': 31053, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY19NTD/2025-11-18/image/bdc21242-4ef3-4ca6-bd22-28ae66f5cffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/60dc6fec-121d-4d1c-b3b9-3dee5396769b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/74e236b1-3cf4-4145-8b50-c46d10eb99d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/7c814446-abc8-492b-af08-e7985c8519e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/633362ed-0960-4475-8fc3-d5250f63ef03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/c0a6d51e-a6f9-4cd4-819d-089acffbe0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/5a168922-4644-4c5b-980c-63a0b67cd27f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/18ca4595-060c-4750-93d3-7849d12bd93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/2b782fd1-97de-4707-a4c7-c40877e9c653_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/afb37653-20c4-473a-9bfc-d6a233e96b6c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/22 10K 12/23 15K 07/25 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d785b6f4-42ac-4fde-bfb4-9a8d9f86b71f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117288965, 'registration': 'EY19NTD', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T N-Connecta 5dr', 'mileage': 31053, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY19NTD/2025-11-18/image/bdc21242-4ef3-4ca6-bd22-28ae66f5cffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/60dc6fec-121d-4d1c-b3b9-3dee5396769b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/74e236b1-3cf4-4145-8b50-c46d10eb99d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/7c814446-abc8-492b-af08-e7985c8519e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/633362ed-0960-4475-8fc3-d5250f63ef03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/c0a6d51e-a6f9-4cd4-819d-089acffbe0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/5a168922-4644-4c5b-980c-63a0b67cd27f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/18ca4595-060c-4750-93d3-7849d12bd93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/2b782fd1-97de-4707-a4c7-c40877e9c653_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/afb37653-20c4-473a-9bfc-d6a233e96b6c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/22 10K 12/23 15K 07/25 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d785b6f4-42ac-4fde-bfb4-9a8d9f86b71f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965
2025-11-27 19:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700bb410-50f1-5407-a07e-ce149793c990 with scrape type 2
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700bb410-50f1-5407-a07e-ce149793c990 with scrape type 2
2025-11-27 19:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 700bb410-50f1-5407-a07e-ce149793c990, identifier: 117288965
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Found listing with ID: 117541699
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541699%27 HTTP/1.1" 200 None
2025-11-27 19:03:02 [astonbarclay.gb] INFO: Scrape type for 117541699: 1
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fecd16e9b-369a-413f-a5a0-bc06e5628090.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ecd16e9b-369a-413f-a5a0-bc06e5628090.jpg?w=600 not downloaded yet
2025-11-27 19:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419
2025-11-27 19:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419
2025-11-27 19:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419 to the API
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279bc2fab3-cfaf-5074-af7f-c002ab916246%27 HTTP/1.1" 200 None
2025-11-27 19:03:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9bc2fab3-cfaf-5074-af7f-c002ab916246: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116671419?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9bc2fab3-cfaf-5074-af7f-c002ab916246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP68FOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116671419',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'X-TRAIL STATION WAGON',
 'odometer': 83805,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': 'Wilsons',
 'title': 'NISSAN X-TRAIL STATION WAGON 1.6 DiG-T N-Connecta 5dr [7 Seat]',
 'transmission': 'manual',
 'trim': '1.6 DiG-T N-Connecta 5dr [7 Seat]',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116671419%27 HTTP/1.1" 200 None
2025-11-27 19:03:03 [astonbarclay.gb] INFO: Saving data for 116671419: {'auction_closing_time': 1764666000.0, 'created_time': 1761764871.311254, 'last_price_update_time': 1764270183.235637}
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116671419') HTTP/1.1" 204 0
2025-11-27 19:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214
2025-11-27 19:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214
2025-11-27 19:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214 to the API
2025-11-27 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117121214?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '78b2dd90-e09f-5942-b237-c795adb5ae40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AV18ODA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117121214',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 74568,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': 'MotoNovo Finance',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 1.5 TSI EVO SE 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO SE 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121214%27 HTTP/1.1" 200 None
2025-11-27 19:03:04 [astonbarclay.gb] INFO: Saving data for 117121214: {'auction_closing_time': 1764755100.0, 'created_time': 1762887652.428682, 'last_price_update_time': 1764270184.256706}
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117121214') HTTP/1.1" 204 0
2025-11-27 19:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965
2025-11-27 19:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965
2025-11-27 19:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965 to the API
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27700bb410-50f1-5407-a07e-ce149793c990%27 HTTP/1.1" 200 None
2025-11-27 19:03:04 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 700bb410-50f1-5407-a07e-ce149793c990: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117288965?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '700bb410-50f1-5407-a07e-ce149793c990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY19NTD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117288965',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 31053,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288965%27 HTTP/1.1" 200 None
2025-11-27 19:03:04 [astonbarclay.gb] INFO: Saving data for 117288965: {'auction_closing_time': 1764666000.0, 'created_time': 1763456563.736356, 'last_price_update_time': 1764270184.545776}
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117288965') HTTP/1.1" 204 0
2025-11-27 19:03:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116994676, 'registration': 'LA70WBL', 'account': 'RIC072', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Elite 5dr Auto', 'mileage': 34873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-21', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e0d6548-607b-482e-adb1-f475e672cd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2831fe1e-078f-47b7-8cf7-210553a349b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e2fa0f8-791a-4aa6-a600-dfa9827c0425_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/bbbbf86a-955f-4e96-8afa-77d7478de6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/fe6ce191-71a7-4ef0-bef4-2920d01fa878_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/d79e0f74-8d8f-4809-a114-bee2346e222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/905e19e4-65ac-4458-b125-ff9910f36a12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/3d10a9d3-dd71-4675-9034-acbd1976d202_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/c90b1af9-ccf5-4cf5-94ca-b60d446913f8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 5/24 23K', 'remarks': 'VOSA STATES 22K, 23K, 32K', 'virtual': False, 'seller': 'Richard Nash Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4136264-5507-4695-8198-54c833c850cc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116994676, 'registration': 'LA70WBL', 'account': 'RIC072', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Elite 5dr Auto', 'mileage': 34873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-21', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e0d6548-607b-482e-adb1-f475e672cd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2831fe1e-078f-47b7-8cf7-210553a349b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e2fa0f8-791a-4aa6-a600-dfa9827c0425_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/bbbbf86a-955f-4e96-8afa-77d7478de6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/fe6ce191-71a7-4ef0-bef4-2920d01fa878_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/d79e0f74-8d8f-4809-a114-bee2346e222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/905e19e4-65ac-4458-b125-ff9910f36a12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/3d10a9d3-dd71-4675-9034-acbd1976d202_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/c90b1af9-ccf5-4cf5-94ca-b60d446913f8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 5/24 23K', 'remarks': 'VOSA STATES 22K, 23K, 32K', 'virtual': False, 'seller': 'Richard Nash Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4136264-5507-4695-8198-54c833c850cc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-11-27 19:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6004262-a547-515d-91d0-1af151fe54f7 with scrape type 2
2025-11-27 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6004262-a547-515d-91d0-1af151fe54f7 with scrape type 2
2025-11-27 19:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6004262-a547-515d-91d0-1af151fe54f7, identifier: 116994676
2025-11-27 19:03:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117242983, 'registration': 'EU18VOP', 'account': 'WIL004', 'make': 'TOYOTA', 'model': 'AURIS HATCHBACK', 'derivative': '1.8 Hybrid Excel TSS 5dr CVT [Leather]', 'mileage': 41766, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-03-05', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2025-10-07', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EU18VOP/2025-11-20/image/83b133e3-85ab-4750-ac5e-e460499e6cc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/b6440f60-2640-43ee-85ec-90f1f51665f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/d5afd679-e5c3-4a9d-ac4b-4163a9d62f6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/6c97fb00-5c58-4cec-aa23-227e0d19c8c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/e9f9882e-76b3-42a0-9661-a8a9a863c9f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/8b816f40-5ce3-4699-95eb-104d75b6184a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/28b32584-7cef-4be9-88d0-0b0aec97d9c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/e6a359ab-d8a5-4790-9ee3-ac9fb6cde8f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/454caacb-c5c9-4ac8-9fe5-c971c24d64b0_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 05/20 7K 06/21 9K / INV 08/24 34K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 91, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2a259674-7842-40db-97d9-1297b626ff96.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117242983, 'registration': 'EU18VOP', 'account': 'WIL004', 'make': 'TOYOTA', 'model': 'AURIS HATCHBACK', 'derivative': '1.8 Hybrid Excel TSS 5dr CVT [Leather]', 'mileage': 41766, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-03-05', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2025-10-07', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EU18VOP/2025-11-20/image/83b133e3-85ab-4750-ac5e-e460499e6cc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/b6440f60-2640-43ee-85ec-90f1f51665f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/d5afd679-e5c3-4a9d-ac4b-4163a9d62f6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/6c97fb00-5c58-4cec-aa23-227e0d19c8c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/e9f9882e-76b3-42a0-9661-a8a9a863c9f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/8b816f40-5ce3-4699-95eb-104d75b6184a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/28b32584-7cef-4be9-88d0-0b0aec97d9c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/e6a359ab-d8a5-4790-9ee3-ac9fb6cde8f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU18VOP/2025-11-20/image/454caacb-c5c9-4ac8-9fe5-c971c24d64b0_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 05/20 7K 06/21 9K / INV 08/24 34K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 91, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2a259674-7842-40db-97d9-1297b626ff96.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9236a965-2c6d-54aa-8031-3b525f703b49 with identifier: 117242983
2025-11-27 19:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9236a965-2c6d-54aa-8031-3b525f703b49 with scrape type 2
2025-11-27 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9236a965-2c6d-54aa-8031-3b525f703b49 with scrape type 2
2025-11-27 19:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9236a965-2c6d-54aa-8031-3b525f703b49, identifier: 117242983
2025-11-27 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue)
2025-11-27 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b005a202-0508-4151-a98e-70faa76a4f0c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/dfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FN67FVP/2025-11-27/image/2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117573893?view=catalogue)
2025-11-27 19:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-11-27 19:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-11-27 19:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676 to the API
2025-11-27 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116994676?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a6004262-a547-515d-91d0-1af151fe54f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LA70WBL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116994676',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 34873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seller_name': 'Richard Nash Group',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo [130] Elite 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo [130] Elite 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-11-27 19:03:05 [astonbarclay.gb] INFO: Saving data for 116994676: {'auction_closing_time': 1764331200.0, 'created_time': 1763024478.604471, 'last_price_update_time': 1764270185.150197}
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116994676') HTTP/1.1" 204 0
2025-11-27 19:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9236a965-2c6d-54aa-8031-3b525f703b49 with identifier: 117242983
2025-11-27 19:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9236a965-2c6d-54aa-8031-3b525f703b49 with identifier: 117242983
2025-11-27 19:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9236a965-2c6d-54aa-8031-3b525f703b49 with identifier: 117242983 to the API
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279236a965-2c6d-54aa-8031-3b525f703b49%27 HTTP/1.1" 200 None
2025-11-27 19:03:05 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9236a965-2c6d-54aa-8031-3b525f703b49: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:05 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117242983?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '9236a965-2c6d-54aa-8031-3b525f703b49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EU18VOP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242983',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TOYOTA',
 'model': 'AURIS HATCHBACK',
 'odometer': 41766,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': 'Wilsons',
 'title': 'TOYOTA AURIS HATCHBACK 1.8 Hybrid Excel TSS 5dr CVT [Leather]',
 'transmission': 'automatic',
 'trim': '1.8 Hybrid Excel TSS 5dr CVT [Leather]',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242983%27 HTTP/1.1" 200 None
2025-11-27 19:03:05 [astonbarclay.gb] INFO: Saving data for 117242983: {'auction_closing_time': 1764666000.0, 'created_time': 1763492786.70074, 'last_price_update_time': 1764270185.471785}
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117242983') HTTP/1.1" 204 0
2025-11-27 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a052f7c3-eca6-49f3-bd95-66b74e919858.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/de6a90d3-124e-4c03-86b4-2d807df54123.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/963ad14f-f915-40ef-befc-03303fe17d82.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue)
2025-11-27 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/120a7939-e621-4e00-bdcf-71f655009de7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:05 [scrapy.extensions.logstats] INFO: Crawled 180 pages (at 45 pages/min), scraped 124 items (at 39 items/min)
2025-11-27 19:03:05 [astonbarclay.gb] INFO: Found listing with ID: 117539515
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539515%27 HTTP/1.1" 200 None
2025-11-27 19:03:05 [astonbarclay.gb] INFO: Scrape type for 117539515: 1
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg?w=600 not downloaded yet
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd47850>
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg?w=600 saved to cache
2025-11-27 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c33cd50>
2025-11-27 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F721c13b2-e761-4d2b-8268-f764f22e9006.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/721c13b2-e761-4d2b-8268-f764f22e9006.jpg?w=600 saved to cache
2025-11-27 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaf6d10>
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa9b7b95c-f0fa-4656-8424-7204f59946e1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a9b7b95c-f0fa-4656-8424-7204f59946e1.jpg?w=600 saved to cache
2025-11-27 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e81cc90>
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Ff4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/f4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98da10>
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252Fb9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e8151d0>
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue)
2025-11-27 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/c41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:03:07 [astonbarclay.gb] INFO: Found listing with ID: 117487536
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117487536%27 HTTP/1.1" 200 None
2025-11-27 19:03:07 [astonbarclay.gb] INFO: Scrape type for 117487536: 0
2025-11-27 19:03:07 [astonbarclay.gb] INFO: Found listing with ID: 117420120
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420120%27 HTTP/1.1" 200 None
2025-11-27 19:03:07 [astonbarclay.gb] INFO: Scrape type for 117420120: 0
2025-11-27 19:03:07 [astonbarclay.gb] INFO: Found listing with ID: 117543930
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543930%27 HTTP/1.1" 200 None
2025-11-27 19:03:07 [astonbarclay.gb] INFO: Scrape type for 117543930: 1
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg?w=600 not downloaded yet
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd7a910>
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg?w=600 saved to cache
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaf6010>
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb005a202-0508-4151-a98e-70faa76a4f0c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b005a202-0508-4151-a98e-70faa76a4f0c.jpg?w=600 saved to cache
2025-11-27 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb84350>
2025-11-27 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fdfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/dfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9f72d0>
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFN67FVP%252F2025-11-27%252Fimage%252F2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FN67FVP/2025-11-27/image/2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a
2025-11-27 19:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a, skipping ID generation
2025-11-27 19:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a with scrape type 1
2025-11-27 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a from tracking dictionaries
2025-11-27 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a sending to next pipeline
2025-11-27 19:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a, identifier: 117573893
2025-11-27 19:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a with identifier: 117573893
2025-11-27 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a with identifier: 117573893
2025-11-27 19:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0c08f89f-4ca7-5e7a-a6cd-127311a06e8a with identifier: 117573893 to the API
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FN67FVP/2025-11-27/image/2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0c08f89f-4ca7-5e7a-a6cd-127311a06e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FN67FVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573893',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA DIESEL GRAND SPORT',
 'odometer': 90696,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27672,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/74d80cbb-c539-46b2-926d-5c8023291adc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31228,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/122ca5bb-d50d-4ffc-bf37-70c6afe3e502_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29740,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2468c72-44e3-4e18-b641-00480b657dca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27608,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/29f2e133-1740-4fa6-9be3-852ad2918b87_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40707,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b2c2fa06-9d6e-4c72-b2a7-0331a4a12313_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48188,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/53a64b8c-3686-40be-8849-1287e240dc77_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41745,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/b9860df0-f284-4259-8c6c-8383d19e03a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33247,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/7f84c9c4-a118-4e26-97e0-5590c6200bc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c08f89f-4ca7-5e7a-a6cd-127311a06e8a/0c08f89f-4ca7-5e7a-a6cd-127311a06e8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46138,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FN67FVP/2025-11-27/image/2d1d6020-595d-41c4-b57e-fe008bfa948e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-15',
 'seller_name': 'MotoNovo Finance',
 'title': 'VAUXHALL INSIGNIA DIESEL GRAND SPORT 1.6 Turbo D ecoTec [136] Elite '
          'Nav 5dr',
 'transmission': 'manual',
 'trim': '1.6 Turbo D ecoTec [136] Elite Nav 5dr',
 'vin': None,
 'year': 2017}
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573893%27 HTTP/1.1" 200 None
2025-11-27 19:03:08 [astonbarclay.gb] INFO: Saving data for 117573893: {'created_time': 1764270188.855562, 'last_price_update_time': 1764270188.855572, 'auction_closing_time': 1764680400.0}
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573893') HTTP/1.1" 204 0
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe68b50>
2025-11-27 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa052f7c3-eca6-49f3-bd95-66b74e919858.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a052f7c3-eca6-49f3-bd95-66b74e919858.jpg?w=600 saved to cache
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdff290>
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fde6a90d3-124e-4c03-86b4-2d807df54123.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/de6a90d3-124e-4c03-86b4-2d807df54123.jpg?w=600 saved to cache
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9a9c90>
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F963ad14f-f915-40ef-befc-03303fe17d82.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/963ad14f-f915-40ef-befc-03303fe17d82.jpg?w=600 saved to cache
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e8516d0>
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F120a7939-e621-4e00-bdcf-71f655009de7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/120a7939-e621-4e00-bdcf-71f655009de7.jpg?w=600 saved to cache
2025-11-27 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9a91d0>
2025-11-27 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1c3d0>
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg?w=600 saved to cache
2025-11-27 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/da6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543370?view=catalogue)
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR18FUO/2025-11-27/image/0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117532070?view=catalogue)
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ecd16e9b-369a-413f-a5a0-bc06e5628090.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:10 [astonbarclay.gb] INFO: Found listing with ID: 117514806
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514806%27 HTTP/1.1" 200 None
2025-11-27 19:03:10 [astonbarclay.gb] INFO: Scrape type for 117514806: 1
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb34becc2-f844-46fb-a985-4402fafd53f4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b34becc2-f844-46fb-a985-4402fafd53f4.jpg?w=600 not downloaded yet
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/c61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117457340?view=catalogue)
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117400496?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecda750>
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg?w=600 saved to cache
2025-11-27 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0d850>
2025-11-27 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fc41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/c41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 117484807
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484807%27 HTTP/1.1" 200 None
2025-11-27 19:03:11 [astonbarclay.gb] INFO: Scrape type for 117484807: 0
2025-11-27 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 117535067
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117535067%27 HTTP/1.1" 200 None
2025-11-27 19:03:11 [astonbarclay.gb] INFO: Scrape type for 117535067: 1
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg?w=600 not downloaded yet
2025-11-27 19:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:11 [astonbarclay.gb] INFO: Found listing with ID: 117514835
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514835%27 HTTP/1.1" 200 None
2025-11-27 19:03:11 [astonbarclay.gb] INFO: Scrape type for 117514835: 1
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec6f090>
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252F797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb92850>
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg?w=600 saved to cache
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb6110>
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252Fda6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/da6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe52bd0>
2025-11-27 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg?w=600 saved to cache
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4561a44-dba3-5e92-af4c-a7f723947a96
2025-11-27 19:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4561a44-dba3-5e92-af4c-a7f723947a96, skipping ID generation
2025-11-27 19:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4561a44-dba3-5e92-af4c-a7f723947a96 with scrape type 1
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a4561a44-dba3-5e92-af4c-a7f723947a96 from tracking dictionaries
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4561a44-dba3-5e92-af4c-a7f723947a96 sending to next pipeline
2025-11-27 19:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a4561a44-dba3-5e92-af4c-a7f723947a96, identifier: 117543370
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd71650>
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR18FUO%252F2025-11-27%252Fimage%252F0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR18FUO/2025-11-27/image/0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fc069a1-87ad-5103-af81-7b392c39aa5f
2025-11-27 19:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fc069a1-87ad-5103-af81-7b392c39aa5f, skipping ID generation
2025-11-27 19:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc069a1-87ad-5103-af81-7b392c39aa5f with scrape type 1
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0fc069a1-87ad-5103-af81-7b392c39aa5f from tracking dictionaries
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fc069a1-87ad-5103-af81-7b392c39aa5f sending to next pipeline
2025-11-27 19:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0fc069a1-87ad-5103-af81-7b392c39aa5f, identifier: 117532070
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d080350>
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fecd16e9b-369a-413f-a5a0-bc06e5628090.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ecd16e9b-369a-413f-a5a0-bc06e5628090.jpg?w=600 saved to cache
2025-11-27 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d109010>
2025-11-27 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE68ZXH%252F2025-11-27%252Fimage%252Fc61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/c61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 308654c0-2c11-5d85-a4d4-a706cc1d695f
2025-11-27 19:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 308654c0-2c11-5d85-a4d4-a706cc1d695f, skipping ID generation
2025-11-27 19:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308654c0-2c11-5d85-a4d4-a706cc1d695f with scrape type 1
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 308654c0-2c11-5d85-a4d4-a706cc1d695f from tracking dictionaries
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 308654c0-2c11-5d85-a4d4-a706cc1d695f sending to next pipeline
2025-11-27 19:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 308654c0-2c11-5d85-a4d4-a706cc1d695f, identifier: 117457340
2025-11-27 19:03:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576544, 'registration': 'WP19RYF', 'account': 'GAT001', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 220 AMG Line Premium 4dr Tip Auto', 'mileage': 68352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3d3c8f4-3d0b-4575-8b4f-1cedf221a9ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576544, 'registration': 'WP19RYF', 'account': 'GAT001', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 220 AMG Line Premium 4dr Tip Auto', 'mileage': 68352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3d3c8f4-3d0b-4575-8b4f-1cedf221a9ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544
2025-11-27 19:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 094982e7-633f-5eb0-bb0f-0ae4dc90868a with scrape type 1
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 094982e7-633f-5eb0-bb0f-0ae4dc90868a
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 094982e7-633f-5eb0-bb0f-0ae4dc90868a
2025-11-27 19:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 094982e7-633f-5eb0-bb0f-0ae4dc90868a, identifier: 117576544
2025-11-27 19:03:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117400496, 'registration': 'LA69KUK', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 75037, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-14', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e505a33b-6690-43c9-9bcb-40e5b7c59212.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117400496, 'registration': 'LA69KUK', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 75037, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-11-14', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e505a33b-6690-43c9-9bcb-40e5b7c59212.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f54695c4-2bee-5c08-b9e9-e7f06c762d84 with identifier: 117400496
2025-11-27 19:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f54695c4-2bee-5c08-b9e9-e7f06c762d84 with scrape type 1
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f54695c4-2bee-5c08-b9e9-e7f06c762d84
2025-11-27 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f54695c4-2bee-5c08-b9e9-e7f06c762d84
2025-11-27 19:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f54695c4-2bee-5c08-b9e9-e7f06c762d84, identifier: 117400496
2025-11-27 19:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a4561a44-dba3-5e92-af4c-a7f723947a96 with identifier: 117543370
2025-11-27 19:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a4561a44-dba3-5e92-af4c-a7f723947a96 with identifier: 117543370
2025-11-27 19:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a4561a44-dba3-5e92-af4c-a7f723947a96 with identifier: 117543370 to the API
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a4561a44-dba3-5e92-af4c-a7f723947a96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DP21RWW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117543370',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 40301,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57677,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/7026a4cb-aa79-4d0e-9b80-71d59a0ea252.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59850,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/8a2b2f4d-97bf-4456-ac60-10c8ec16f9c0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42680,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/1df4d426-0697-4a9c-a5dc-76930fa0fd9d.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59169,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/30e35799-3fe3-4442-9c4a-2ab2b62efce7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45477,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/7a9424bc-db7f-458a-a017-2ff02a4ff6b5.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39980,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/f75b4800-e4a5-491c-9952-a52eb3be4fb4.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4561a44-dba3-5e92-af4c-a7f723947a96/a4561a44-dba3-5e92-af4c-a7f723947a96_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44711,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/963ad14f-f915-40ef-befc-03303fe17d82.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-17',
 'seller_name': 'Vantage Motor Group',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 SE 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543370%27 HTTP/1.1" 200 None
2025-11-27 19:03:13 [astonbarclay.gb] INFO: Saving data for 117543370: {'created_time': 1764270193.911717, 'last_price_update_time': 1764270193.911726, 'auction_closing_time': 1764680400.0}
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117543370') HTTP/1.1" 204 0
2025-11-27 19:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0fc069a1-87ad-5103-af81-7b392c39aa5f with identifier: 117532070
2025-11-27 19:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0fc069a1-87ad-5103-af81-7b392c39aa5f with identifier: 117532070
2025-11-27 19:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0fc069a1-87ad-5103-af81-7b392c39aa5f with identifier: 117532070 to the API
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YR18FUO/2025-11-27/image/0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0fc069a1-87ad-5103-af81-7b392c39aa5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YR18FUO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117532070',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MAZDA',
 'model': 'MAZDA3 DIESEL HATCHBACK',
 'odometer': 28873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20084,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/354894de-c0d3-4b78-b77d-0e5dcc82d84c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20885,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/7396d83d-6b27-4815-8024-fb2cf394c00b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22101,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/da6045d6-8327-403c-9386-3eb10b143c74_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21465,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/efec3f30-e00d-483a-acaa-39feb4a4f9a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36398,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/c41e9ce1-c106-43f2-ad1f-4e39d1c88dda_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46167,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/f4e673bc-6868-4491-8ce8-1a77f9b3cb7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27408,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/dfdc2a3a-133b-4875-8e4e-21c1a8bbab6d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34674,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/8d0b0777-ec7a-467b-bc6a-ca200eeca3d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fc069a1-87ad-5103-af81-7b392c39aa5f/0fc069a1-87ad-5103-af81-7b392c39aa5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40345,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YR18FUO/2025-11-27/image/0e599ddb-a359-46de-be00-7e94ef6fb4fe_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': 'TCB Group - Prime',
 'title': 'MAZDA MAZDA3 DIESEL HATCHBACK 2.2d SE-L Nav 5dr',
 'transmission': 'manual',
 'trim': '2.2d SE-L Nav 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117532070%27 HTTP/1.1" 200 None
2025-11-27 19:03:14 [astonbarclay.gb] INFO: Saving data for 117532070: {'created_time': 1764270194.290173, 'last_price_update_time': 1764270194.290187, 'auction_closing_time': 1764680400.0}
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117532070') HTTP/1.1" 204 0
2025-11-27 19:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 308654c0-2c11-5d85-a4d4-a706cc1d695f with identifier: 117457340
2025-11-27 19:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 308654c0-2c11-5d85-a4d4-a706cc1d695f with identifier: 117457340
2025-11-27 19:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 308654c0-2c11-5d85-a4d4-a706cc1d695f with identifier: 117457340 to the API
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/c61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '308654c0-2c11-5d85-a4d4-a706cc1d695f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PE68ZXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117457340',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'YARIS HATCHBACK',
 'odometer': 59215,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28456,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e46f7ba6-dd04-45fa-80aa-e58af44941b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27956,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/7ae2d7e7-6b89-4335-bf4f-2f10a1b673ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23562,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/2e8f3054-abc8-4ebf-b3d1-645abf5c777f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23494,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/791cc718-c717-4bdb-a1e7-8992fcffad0e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42340,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/e67fb06f-4807-4ee0-99a0-2860c09d1e45_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50252,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/98d55bc8-8706-4cd6-9ee2-9dd8938a73a1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34498,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/c61480c9-c1df-495d-8c6b-db0c6f365d83_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55205,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/0b9ee47d-2fbe-4f0f-a377-1585f80b4806_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_308654c0-2c11-5d85-a4d4-a706cc1d695f/308654c0-2c11-5d85-a4d4-a706cc1d695f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46075,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PE68ZXH/2025-11-27/image/797a81fc-1741-45d6-9973-90136c7782bf_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-19',
 'seller_name': 'Vantage Motor Group',
 'title': 'TOYOTA YARIS HATCHBACK 1.5 VVT-i Icon Tech 5dr',
 'transmission': 'manual',
 'trim': '1.5 VVT-i Icon Tech 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457340%27 HTTP/1.1" 200 None
2025-11-27 19:03:14 [astonbarclay.gb] INFO: Saving data for 117457340: {'created_time': 1764270194.689242, 'last_price_update_time': 1764270194.689255, 'auction_closing_time': 1764680400.0}
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117457340') HTTP/1.1" 204 0
2025-11-27 19:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544
2025-11-27 19:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544
2025-11-27 19:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544 to the API
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27094982e7-633f-5eb0-bb0f-0ae4dc90868a%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 094982e7-633f-5eb0-bb0f-0ae4dc90868a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:14 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '094982e7-633f-5eb0-bb0f-0ae4dc90868a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WP19RYF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576544',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 68352,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': 'Gates Group',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 220 AMG Line Premium 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 220 AMG Line Premium 4dr Tip Auto',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576544%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Saving data for 117576544: {'created_time': 1764270195.035851, 'last_price_update_time': 1764270195.03586, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576544') HTTP/1.1" 204 0
2025-11-27 19:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f54695c4-2bee-5c08-b9e9-e7f06c762d84 with identifier: 117400496
2025-11-27 19:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f54695c4-2bee-5c08-b9e9-e7f06c762d84 with identifier: 117400496
2025-11-27 19:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f54695c4-2bee-5c08-b9e9-e7f06c762d84 with identifier: 117400496 to the API
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f54695c4-2bee-5c08-b9e9-e7f06c762d84%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f54695c4-2bee-5c08-b9e9-e7f06c762d84: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:14 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117400496?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'f54695c4-2bee-5c08-b9e9-e7f06c762d84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LA69KUK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117400496',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 75037,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Exclusive 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400496%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Saving data for 117400496: {'created_time': 1764270195.335474, 'last_price_update_time': 1764270195.335483, 'auction_closing_time': 1764755100.0}
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117400496') HTTP/1.1" 204 0
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b34becc2-f844-46fb-a985-4402fafd53f4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Found listing with ID: 116918961
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116918961%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Scrape type for 116918961: 1
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117451351?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117400527?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576494?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115431227?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Found listing with ID: 117331028
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331028%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Scrape type for 117331028: 1
2025-11-27 19:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Found listing with ID: 117514787
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514787%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Scrape type for 117514787: 1
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Found listing with ID: 117525337
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117525337%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Scrape type for 117525337: 1
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Found listing with ID: 117542051
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542051%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Scrape type for 117542051: 1
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Found listing with ID: 117413519
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117413519%27 HTTP/1.1" 200 None
2025-11-27 19:03:15 [astonbarclay.gb] INFO: Scrape type for 117413519: 2
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d52eb10>
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_12.jpg HTTP/1.1" 201 0
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb34becc2-f844-46fb-a985-4402fafd53f4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b34becc2-f844-46fb-a985-4402fafd53f4.jpg?w=600 saved to cache
2025-11-27 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb53e10>
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_10.jpg HTTP/1.1" 201 0
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg?w=600 saved to cache
2025-11-27 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e826bd0>
2025-11-27 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_11.jpg HTTP/1.1" 201 0
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg?w=600 saved to cache
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117541958
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541958%27 HTTP/1.1" 200 None
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117541958: 1
2025-11-27 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117510413?view=catalogue)
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117576566
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576566%27 HTTP/1.1" 200 None
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117576566: 1
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117415236
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415236%27 HTTP/1.1" 200 None
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117415236: 0
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Found listing with ID: 117576508
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576508%27 HTTP/1.1" 200 None
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Scrape type for 117576508: 1
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117451351, 'registration': 'RO74OJN', 'account': 'STE095', 'make': 'AUDI', 'model': 'Q3 ESTATE', 'derivative': '45 TFSI 245 Quattro S Line 5dr S Tronic [Leather]', 'mileage': 6785, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO74OJN/2025-11-26/image/9fa76d6b-bebd-4cdf-a183-977668257c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/b3af0173-762a-455e-9e7f-cded9b4c01be_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/8fabe604-2e27-41a0-8a07-4afbfb5c76d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/68e567d6-3f98-4fdc-8b65-379132dcbfc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/f8230d8a-231f-44a5-89b0-fe82fe721943_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/6ee475ce-8890-4a37-a593-01c30d30d76d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/0811cde2-67a2-46eb-a9ae-01290b503890_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/4de1a3f9-cc4e-4efa-8876-d568fe8ef2b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/0af16fb4-c79a-4989-8be0-d81f6503434a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/36d3a083-cbbc-4648-b424-64c0a5654cba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 202, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ffe9161-2bc6-4893-a5d5-e91a5f792a35.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117451351, 'registration': 'RO74OJN', 'account': 'STE095', 'make': 'AUDI', 'model': 'Q3 ESTATE', 'derivative': '45 TFSI 245 Quattro S Line 5dr S Tronic [Leather]', 'mileage': 6785, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-09-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RO74OJN/2025-11-26/image/9fa76d6b-bebd-4cdf-a183-977668257c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/b3af0173-762a-455e-9e7f-cded9b4c01be_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/8fabe604-2e27-41a0-8a07-4afbfb5c76d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/68e567d6-3f98-4fdc-8b65-379132dcbfc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/f8230d8a-231f-44a5-89b0-fe82fe721943_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/6ee475ce-8890-4a37-a593-01c30d30d76d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/0811cde2-67a2-46eb-a9ae-01290b503890_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/4de1a3f9-cc4e-4efa-8876-d568fe8ef2b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/0af16fb4-c79a-4989-8be0-d81f6503434a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO74OJN/2025-11-26/image/36d3a083-cbbc-4648-b424-64c0a5654cba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 202, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ffe9161-2bc6-4893-a5d5-e91a5f792a35.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea42f07-76e9-54a9-875e-c6f02f0ed2f8 with identifier: 117451351
2025-11-27 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea42f07-76e9-54a9-875e-c6f02f0ed2f8 with scrape type 2
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea42f07-76e9-54a9-875e-c6f02f0ed2f8 with scrape type 2
2025-11-27 19:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0ea42f07-76e9-54a9-875e-c6f02f0ed2f8, identifier: 117451351
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117400527, 'registration': 'FH66RVR', 'account': 'THE109', 'make': 'AUDI', 'model': 'A5 DIESEL COUPE', 'derivative': '2.0 TDI S Line 2dr S Tronic', 'mileage': 118196, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-12-09', 'fuel': 'Diesel', 'motExpiry': '2026-10-04', 'doors': 2, 'engineSize': 1968, 'bodyType': 'Coupe', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4de6bb76-e09f-4cc4-8218-1909b3d1f325.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117400527, 'registration': 'FH66RVR', 'account': 'THE109', 'make': 'AUDI', 'model': 'A5 DIESEL COUPE', 'derivative': '2.0 TDI S Line 2dr S Tronic', 'mileage': 118196, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-12-09', 'fuel': 'Diesel', 'motExpiry': '2026-10-04', 'doors': 2, 'engineSize': 1968, 'bodyType': 'Coupe', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4de6bb76-e09f-4cc4-8218-1909b3d1f325.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76ba9846-d415-53dd-ae11-e91762a05138 with identifier: 117400527
2025-11-27 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76ba9846-d415-53dd-ae11-e91762a05138 with scrape type 1
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 76ba9846-d415-53dd-ae11-e91762a05138
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 76ba9846-d415-53dd-ae11-e91762a05138
2025-11-27 19:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 76ba9846-d415-53dd-ae11-e91762a05138, identifier: 117400527
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576494, 'registration': 'LT16LYD', 'account': 'GAT001', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 79203, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-27', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ae5049a-71fa-4f42-bc53-ef761e14ce31.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576494, 'registration': 'LT16LYD', 'account': 'GAT001', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 79203, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-27', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ae5049a-71fa-4f42-bc53-ef761e14ce31.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef00e56-a84b-53dc-954f-3c16f278314c with identifier: 117576494
2025-11-27 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef00e56-a84b-53dc-954f-3c16f278314c with scrape type 1
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6ef00e56-a84b-53dc-954f-3c16f278314c
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6ef00e56-a84b-53dc-954f-3c16f278314c
2025-11-27 19:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6ef00e56-a84b-53dc-954f-3c16f278314c, identifier: 117576494
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117541699, 'registration': 'EK72NRE', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-Tech full hybrid 145 Evolution 5dr Auto', 'mileage': 93172, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-15', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EK72NRE/2025-11-27/image/dedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/b5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/24-51K 12/24-74K 10/25-92K', 'remarks': 'SPARE KEY IN OFFICE,', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7705b270-285b-4f9b-92d6-b9a2feda51cf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117541699, 'registration': 'EK72NRE', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-Tech full hybrid 145 Evolution 5dr Auto', 'mileage': 93172, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-15', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EK72NRE/2025-11-27/image/dedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/b5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 04/24-51K 12/24-74K 10/25-92K', 'remarks': 'SPARE KEY IN OFFICE,', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7705b270-285b-4f9b-92d6-b9a2feda51cf.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f143cc3b-0a66-5fe5-9c61-9b40590af7d2 with identifier: 117541699
2025-11-27 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2 with scrape type 1
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fdedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/dedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117536984, 'registration': 'EU22UWP', 'account': 'WBA002', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '1.5 EcoBlue Titanium Edition 5dr Auto', 'mileage': 32700, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EU22UWP/2025-11-27/image/af9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/b6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/eb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 25k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eecce2e3-564a-4c67-9486-b6cb76c80759.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117536984, 'registration': 'EU22UWP', 'account': 'WBA002', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '1.5 EcoBlue Titanium Edition 5dr Auto', 'mileage': 32700, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-02-28', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EU22UWP/2025-11-27/image/af9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/b6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/eb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg?w=600', 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 25k', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eecce2e3-564a-4c67-9486-b6cb76c80759.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b8e66b0-9b65-5140-b305-36d2d317d861 with identifier: 117536984
2025-11-27 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b8e66b0-9b65-5140-b305-36d2d317d861 with scrape type 1
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252Faf9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/af9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 115431227, 'registration': 'FE69XTH', 'account': 'CAR068', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto', 'mileage': 132609, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FE69XTH/2025-09-18/image/08d472c3-e8c7-4c9b-85d4-9be998d05d88_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/cc827c19-5d80-4be3-b42f-e9c1a7f876cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/37731916-7162-4bf7-8099-134e8b521273_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c8beb894-0f9d-41db-9e96-799fa1c2825f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/12b9e71b-5d91-473d-ab23-1617063e02bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/1f306274-08d2-4305-ad7b-85ffaebd19d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/3d8c6113-3e09-4a6c-944a-345a5dfe6968_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/f67f400e-3cd6-4622-9ea1-eb059854befa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/616590e5-fb3e-4c3b-8ee0-33d99547f6f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c7b881a8-4536-4002-940b-d180ee0fb4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/7cec3cbf-5f43-4342-9441-59d0882dbc22_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/64c0e885-bba6-4dab-aedc-d3a64039c20c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 07/20 23K 06/21 46K 05/22 70K 09/23 96K 06/25 132K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Dealer Direct', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9bc575e0-5f86-4fab-ab67-64decc0b0414.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 115431227, 'registration': 'FE69XTH', 'account': 'CAR068', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto', 'mileage': 132609, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FE69XTH/2025-09-18/image/08d472c3-e8c7-4c9b-85d4-9be998d05d88_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/cc827c19-5d80-4be3-b42f-e9c1a7f876cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/37731916-7162-4bf7-8099-134e8b521273_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c8beb894-0f9d-41db-9e96-799fa1c2825f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/12b9e71b-5d91-473d-ab23-1617063e02bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/1f306274-08d2-4305-ad7b-85ffaebd19d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/3d8c6113-3e09-4a6c-944a-345a5dfe6968_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/f67f400e-3cd6-4622-9ea1-eb059854befa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/616590e5-fb3e-4c3b-8ee0-33d99547f6f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c7b881a8-4536-4002-940b-d180ee0fb4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/7cec3cbf-5f43-4342-9441-59d0882dbc22_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/64c0e885-bba6-4dab-aedc-d3a64039c20c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 07/20 23K 06/21 46K 05/22 70K 09/23 96K 06/25 132K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Dealer Direct', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9bc575e0-5f86-4fab-ab67-64decc0b0414.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f111dc5-eecc-5b17-97e5-972164540f4c with identifier: 115431227
2025-11-27 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f111dc5-eecc-5b17-97e5-972164540f4c with scrape type 2
2025-11-27 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f111dc5-eecc-5b17-97e5-972164540f4c with scrape type 2
2025-11-27 19:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8f111dc5-eecc-5b17-97e5-972164540f4c, identifier: 115431227
2025-11-27 19:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0ea42f07-76e9-54a9-875e-c6f02f0ed2f8 with identifier: 117451351
2025-11-27 19:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0ea42f07-76e9-54a9-875e-c6f02f0ed2f8 with identifier: 117451351
2025-11-27 19:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0ea42f07-76e9-54a9-875e-c6f02f0ed2f8 with identifier: 117451351 to the API
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117451351?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0ea42f07-76e9-54a9-875e-c6f02f0ed2f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RO74OJN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117451351',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q3 ESTATE',
 'odometer': 6785,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-25',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'AUDI Q3 ESTATE 45 TFSI 245 Quattro S Line 5dr S Tronic [Leather]',
 'transmission': 'automatic',
 'trim': '45 TFSI 245 Quattro S Line 5dr S Tronic [Leather]',
 'vin': None,
 'year': 2024}
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451351%27 HTTP/1.1" 200 None
2025-11-27 19:03:17 [astonbarclay.gb] INFO: Saving data for 117451351: {'auction_closing_time': 1764756000.0, 'created_time': 1764147705.581227, 'last_price_update_time': 1764270197.054357}
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117451351') HTTP/1.1" 204 0
2025-11-27 19:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 76ba9846-d415-53dd-ae11-e91762a05138 with identifier: 117400527
2025-11-27 19:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 76ba9846-d415-53dd-ae11-e91762a05138 with identifier: 117400527
2025-11-27 19:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190217 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190217
2025-11-27 19:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 76ba9846-d415-53dd-ae11-e91762a05138 spider: astonbarclay.gb
2025-11-27 19:03:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 76ba9846-d415-53dd-ae11-e91762a05138 due to rule: high_mileage_for_country.json, error: 190217 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190217
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '76ba9846-d415-53dd-ae11-e91762a05138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FH66RVR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117400527',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'AUDI',
 'model': 'A5 DIESEL COUPE',
 'odometer': 118196,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-09',
 'seller_name': 'TCB Group - Prime',
 'title': 'AUDI A5 DIESEL COUPE 2.0 TDI S Line 2dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI S Line 2dr S Tronic',
 'vin': None,
 'year': 2016}
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400527%27 HTTP/1.1" 200 None
2025-11-27 19:03:17 [astonbarclay.gb] INFO: Saving data for 117400527: {'created_time': 1764270197.364774, 'last_price_update_time': 1764270197.364781, 'auction_closing_time': 1764755100.0}
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117400527') HTTP/1.1" 204 0
2025-11-27 19:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6ef00e56-a84b-53dc-954f-3c16f278314c with identifier: 117576494
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BROWN HTTP/1.1" 200 None
2025-11-27 19:03:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6ef00e56-a84b-53dc-954f-3c16f278314c with identifier: 117576494
2025-11-27 19:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6ef00e56-a84b-53dc-954f-3c16f278314c with identifier: 117576494 to the API
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276ef00e56-a84b-53dc-954f-3c16f278314c%27 HTTP/1.1" 200 None
2025-11-27 19:03:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6ef00e56-a84b-53dc-954f-3c16f278314c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:17 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576494?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'BROWN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6ef00e56-a84b-53dc-954f-3c16f278314c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT16LYD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576494',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 79203,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Gates Group',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576494%27 HTTP/1.1" 200 None
2025-11-27 19:03:17 [astonbarclay.gb] INFO: Saving data for 117576494: {'created_time': 1764270197.916596, 'last_price_update_time': 1764270197.916609, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576494') HTTP/1.1" 204 0
2025-11-27 19:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8f111dc5-eecc-5b17-97e5-972164540f4c with identifier: 115431227
2025-11-27 19:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8f111dc5-eecc-5b17-97e5-972164540f4c with identifier: 115431227
2025-11-27 19:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'dealer direct', 'price_includes_vat': False, 'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'countryman hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol/plugin electric hybrid', 'odometer': 132609, 'odometer_reading_unit': 'mi', 'registration_date': '2019-09-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227', 'expiration_date': '2025-12-02t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '1.5 cooper s e classic all4 phev 5dr auto', 'license_plate': 'fe69xth', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 43, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8f111dc5-eecc-5b17-97e5-972164540f4c', 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'mini countryman hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 213412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 43,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-02t09:00:00z',
     'fuel_type': 'petrol/plugin electric hybrid',
     'id': '8f111dc5-eecc-5b17-97e5-972164540f4c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fe69xth',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'mini',
     'make_model': 'mini countryman hatchback',
     'model': 'countryman hatchback',
     'odometer': 132609,
     'odometer_in_km': 213412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-09',
     'sanitized_make': 'mini',
     'seller_name': 'dealer direct',
     'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '1.5 cooper s e classic all4 phev 5dr auto',
     'vin': None,
     'year': 2019}
2025-11-27 19:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 8f111dc5-eecc-5b17-97e5-972164540f4c spider: astonbarclay.gb
2025-11-27 19:03:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8f111dc5-eecc-5b17-97e5-972164540f4c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'dealer direct', 'price_includes_vat': False, 'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'countryman hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol/plugin electric hybrid', 'odometer': 132609, 'odometer_reading_unit': 'mi', 'registration_date': '2019-09-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227', 'expiration_date': '2025-12-02t09:00:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '1.5 cooper s e classic all4 phev 5dr auto', 'license_plate': 'fe69xth', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 43, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8f111dc5-eecc-5b17-97e5-972164540f4c', 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'mini countryman hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 213412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 43,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-02t09:00:00z',
     'fuel_type': 'petrol/plugin electric hybrid',
     'id': '8f111dc5-eecc-5b17-97e5-972164540f4c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fe69xth',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'mini',
     'make_model': 'mini countryman hatchback',
     'model': 'countryman hatchback',
     'odometer': 132609,
     'odometer_in_km': 213412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-09',
     'sanitized_make': 'mini',
     'seller_name': 'dealer direct',
     'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '1.5 cooper s e classic all4 phev 5dr auto',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '8f111dc5-eecc-5b17-97e5-972164540f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FE69XTH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MINI',
 'model': 'COUNTRYMAN HATCHBACK',
 'odometer': 132609,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': 'Dealer Direct',
 'title': 'MINI COUNTRYMAN HATCHBACK 1.5 Cooper S E Classic ALL4 PHEV 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115431227%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Saving data for 115431227: {'auction_closing_time': 1764666000.0, 'created_time': 1758186113.099485, 'last_price_update_time': 1764270198.16665}
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115431227') HTTP/1.1" 204 0
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Found listing with ID: 117459934
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459934%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Scrape type for 117459934: 0
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Found listing with ID: 117512026
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117512026%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Scrape type for 117512026: 1
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252Fb6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/b6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116989244?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Found listing with ID: 117546419
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546419%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Scrape type for 117546419: 0
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Found listing with ID: 117542492
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542492%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Scrape type for 117542492: 1
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d15ccd0>
2025-11-27 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_13.jpg HTTP/1.1" 201 0
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg?w=600 saved to cache
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a
2025-11-27 19:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4da9673-5b8e-5a2f-8c1a-389b5438e23a, skipping ID generation
2025-11-27 19:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a with scrape type 1
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b4da9673-5b8e-5a2f-8c1a-389b5438e23a from tracking dictionaries
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4da9673-5b8e-5a2f-8c1a-389b5438e23a sending to next pipeline
2025-11-27 19:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b4da9673-5b8e-5a2f-8c1a-389b5438e23a, identifier: 117510413
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Found listing with ID: 117461867
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117461867%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Scrape type for 117461867: 0
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Found listing with ID: 117544119
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544119%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [astonbarclay.gb] INFO: Scrape type for 117544119: 1
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fb5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/b5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b4da9673-5b8e-5a2f-8c1a-389b5438e23a with identifier: 117510413
2025-11-27 19:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b4da9673-5b8e-5a2f-8c1a-389b5438e23a with identifier: 117510413
2025-11-27 19:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b4da9673-5b8e-5a2f-8c1a-389b5438e23a with identifier: 117510413 to the API
2025-11-27 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b4da9673-5b8e-5a2f-8c1a-389b5438e23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LC68JOU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117510413',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 50353,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58075,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/4bf3fe4f-7ec2-45fc-9929-12ee99c3dda1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61812,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/721c13b2-e761-4d2b-8268-f764f22e9006.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51317,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/b005a202-0508-4151-a98e-70faa76a4f0c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50065,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/de6a90d3-124e-4c03-86b4-2d807df54123.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57062,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/120a7939-e621-4e00-bdcf-71f655009de7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62904,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/a9b7b95c-f0fa-4656-8424-7204f59946e1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65457,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/917c8f7f-1606-4edb-bf4b-165a5a50457d.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40781,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/a052f7c3-eca6-49f3-bd95-66b74e919858.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42361,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/559e169a-3311-4dc7-92bb-f4b72d3baf56.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42344,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/ecd16e9b-369a-413f-a5a0-bc06e5628090.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41914,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/2a3fb835-1430-4033-aff7-26f57cf78cdd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38693,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/23039b7c-4c10-4416-b3e1-7c8e3c0c697f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50334,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/b34becc2-f844-46fb-a985-4402fafd53f4.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4da9673-5b8e-5a2f-8c1a-389b5438e23a/b4da9673-5b8e-5a2f-8c1a-389b5438e23a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53913,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/27743d5f-d31c-468f-87c3-d1abc46cd6e9.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seller_name': 'Vantage Motor Group',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 82 Feel Nav Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Feel Nav Edition 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117510413%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Saving data for 117510413: {'created_time': 1764270199.179287, 'last_price_update_time': 1764270199.179301, 'auction_closing_time': 1764680400.0}
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117510413') HTTP/1.1" 204 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 116994755
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994755%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 116994755: 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117546520
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546520%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 117546520: 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117548257
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548257%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 117548257: 1
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116989244, 'registration': 'SL71BVR', 'account': 'KAA001', 'make': 'KIA', 'model': 'CEED DIESEL SPORTSWAGON', 'derivative': '1.6 CRDi 48V ISG 2 NAV 5dr', 'mileage': 71388, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-12-07', 'fuel': 'Diesel', 'motExpiry': '2026-01-07', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SL71BVR/2025-11-06/image/0c9c76cc-cacf-41ec-8fc6-d4635cc9e9a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e53f7889-58e4-4f65-9389-679f1205907e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/c8a11b46-c87e-4ec3-9698-a43867d7f1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/9a717801-7853-4876-baa9-13ba2d697b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e3c66449-e2c9-48a4-b1ec-0ab975b039d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/dd28e829-c15e-4cb5-a3d9-ec8f2457f97e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/22 10K 06/22 20K 01/23 31K 03/23 40K 08/23 48K 06/24 62K 10/24 67K', 'remarks': 'Ex-Private Hire / SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f6cc9b1a-9853-42ca-86eb-ff4c00dba1bb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116989244, 'registration': 'SL71BVR', 'account': 'KAA001', 'make': 'KIA', 'model': 'CEED DIESEL SPORTSWAGON', 'derivative': '1.6 CRDi 48V ISG 2 NAV 5dr', 'mileage': 71388, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 92}, 'saleStart': '2025-12-02T09:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-12-07', 'fuel': 'Diesel', 'motExpiry': '2026-01-07', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SL71BVR/2025-11-06/image/0c9c76cc-cacf-41ec-8fc6-d4635cc9e9a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e53f7889-58e4-4f65-9389-679f1205907e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/c8a11b46-c87e-4ec3-9698-a43867d7f1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/9a717801-7853-4876-baa9-13ba2d697b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e3c66449-e2c9-48a4-b1ec-0ab975b039d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/dd28e829-c15e-4cb5-a3d9-ec8f2457f97e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/22 10K 06/22 20K 01/23 31K 03/23 40K 08/23 48K 06/24 62K 10/24 67K', 'remarks': 'Ex-Private Hire / SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f6cc9b1a-9853-42ca-86eb-ff4c00dba1bb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244
2025-11-27 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eedd20e-c246-5175-84a3-54b0e5bc9635 with scrape type 2
2025-11-27 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eedd20e-c246-5175-84a3-54b0e5bc9635 with scrape type 2
2025-11-27 19:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2eedd20e-c246-5175-84a3-54b0e5bc9635, identifier: 116989244
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117543930, 'registration': 'KW20DBU', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL COUPE', 'derivative': 'E220d AMG Line Premium Plus 2dr 9G-Tronic', 'mileage': 56602, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-07-29', 'fuel': 'Diesel', 'motExpiry': '2026-07-16', 'doors': 2, 'engineSize': 1950, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/KW20DBU/2025-11-27/image/da0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/21- 10K, 08/22- 20K, 09/23- 29K, 07/24- 37K', 'remarks': 'VOSA STATES 29K, 37K, 52K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 167, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff8fd5df-0d53-4bbb-a336-540f4389baf5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117543930, 'registration': 'KW20DBU', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL COUPE', 'derivative': 'E220d AMG Line Premium Plus 2dr 9G-Tronic', 'mileage': 56602, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-07-29', 'fuel': 'Diesel', 'motExpiry': '2026-07-16', 'doors': 2, 'engineSize': 1950, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/KW20DBU/2025-11-27/image/da0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/21- 10K, 08/22- 20K, 09/23- 29K, 07/24- 37K', 'remarks': 'VOSA STATES 29K, 37K, 52K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 167, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff8fd5df-0d53-4bbb-a336-540f4389baf5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6eec1b7-60b4-5097-b454-91fd41955aab with identifier: 117543930
2025-11-27 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6eec1b7-60b4-5097-b454-91fd41955aab with scrape type 1
2025-11-27 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252Fda0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/da0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116884491?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117514835?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117022539?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117514806?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117023522?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244
2025-11-27 19:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244
2025-11-27 19:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244 to the API
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272eedd20e-c246-5175-84a3-54b0e5bc9635%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2eedd20e-c246-5175-84a3-54b0e5bc9635: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116989244?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '2eedd20e-c246-5175-84a3-54b0e5bc9635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SL71BVR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116989244',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'KIA',
 'model': 'CEED DIESEL SPORTSWAGON',
 'odometer': 71388,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seller_name': 'Local Dealer Group',
 'title': 'KIA CEED DIESEL SPORTSWAGON 1.6 CRDi 48V ISG 2 NAV 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi 48V ISG 2 NAV 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116989244%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Saving data for 116989244: {'auction_closing_time': 1764666000.0, 'created_time': 1762369429.649574, 'last_price_update_time': 1764270199.85837}
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116989244') HTTP/1.1" 204 0
2025-11-27 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/b6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117546506
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546506%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 117546506: 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117546450
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546450%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 117546450: 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117537363
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537363%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 117537363: 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117458458
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458458%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 117458458: 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117546474
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546474%27 HTTP/1.1" 200 None
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Scrape type for 117546474: 0
2025-11-27 19:03:19 [astonbarclay.gb] INFO: Found listing with ID: 117515289
2025-11-27 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515289%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Scrape type for 117515289: 1
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fc0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252Fe9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Found listing with ID: 117489004
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489004%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Scrape type for 117489004: 0
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Found listing with ID: 117422410
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422410%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Scrape type for 117422410: 0
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Found listing with ID: 117509153
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509153%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Scrape type for 117509153: 2
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252Feb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/eb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9dae50>
2025-11-27 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116884491, 'registration': 'DK66OVP', 'account': 'CAR400', 'make': 'FORD', 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 EcoBoost Zetec White 5dr', 'mileage': 72063, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2025-02-02', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK66OVP/2025-11-06/image/6d9d2193-c4d6-458d-ab77-e2321c3f40b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/7c7bdec2-892a-481f-92cf-6f815f40ab17_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/2a0c7d7c-46ee-429f-bccb-58b57cfdf6c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/49dece4c-9045-4c49-b9f9-4754509a4970_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/d29893e6-954e-4aa2-afa7-4631e330f2a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/1a0a9264-8bde-4078-aae0-73aea4b088e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/2d5e2d0b-c58a-409b-81fe-19c4ec967dad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/8ef65481-b014-4c5b-8828-2d9275045c84_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/94d47729-e17b-4eac-98a8-c4b267c60322_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/7af6f687-13f8-40bc-b67b-8da9244efa35_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 27K- 41K- 54K - 64K -', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3fc1d85c-9815-456c-a91d-264f9dfa8a3f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116884491, 'registration': 'DK66OVP', 'account': 'CAR400', 'make': 'FORD', 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 EcoBoost Zetec White 5dr', 'mileage': 72063, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2025-02-02', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DK66OVP/2025-11-06/image/6d9d2193-c4d6-458d-ab77-e2321c3f40b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/7c7bdec2-892a-481f-92cf-6f815f40ab17_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/2a0c7d7c-46ee-429f-bccb-58b57cfdf6c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/49dece4c-9045-4c49-b9f9-4754509a4970_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/d29893e6-954e-4aa2-afa7-4631e330f2a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/1a0a9264-8bde-4078-aae0-73aea4b088e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/2d5e2d0b-c58a-409b-81fe-19c4ec967dad_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/8ef65481-b014-4c5b-8828-2d9275045c84_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/94d47729-e17b-4eac-98a8-c4b267c60322_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK66OVP/2025-11-06/image/7af6f687-13f8-40bc-b67b-8da9244efa35_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 27K- 41K- 54K - 64K -', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3fc1d85c-9815-456c-a91d-264f9dfa8a3f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08 with identifier: 116884491
2025-11-27 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08 with scrape type 2
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08 with scrape type 2
2025-11-27 19:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08, identifier: 116884491
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117514835, 'registration': 'EK20UXC', 'account': 'GAT002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line X Edition 5dr', 'mileage': 48111, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-07-07', 'fuel': 'Petrol', 'motExpiry': '2026-04-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e426e021-956e-4d7b-a433-04584e9b10fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117514835, 'registration': 'EK20UXC', 'account': 'GAT002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line X Edition 5dr', 'mileage': 48111, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-07-07', 'fuel': 'Petrol', 'motExpiry': '2026-04-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e426e021-956e-4d7b-a433-04584e9b10fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e574254-b04a-502c-8b01-5eb03179ff3e with identifier: 117514835
2025-11-27 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e574254-b04a-502c-8b01-5eb03179ff3e with scrape type 1
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5e574254-b04a-502c-8b01-5eb03179ff3e
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5e574254-b04a-502c-8b01-5eb03179ff3e
2025-11-27 19:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5e574254-b04a-502c-8b01-5eb03179ff3e, identifier: 117514835
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117539515, 'registration': 'EA70BPV', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Clusiv 5dr x-shift', 'mileage': 13172, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-10-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-04', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/f493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/fa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/db4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/21- 2K, 09/22- 6K, 10/23- 11K, 11/24- 12K, 10/25- 13K', 'remarks': 'VOSA STATES 11K, 12K, 13K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b6927eb1-044a-4a77-8b79-72f09af092fa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117539515, 'registration': 'EA70BPV', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'AYGO HATCHBACK', 'derivative': '1.0 VVT-i X-Clusiv 5dr x-shift', 'mileage': 13172, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-10-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-04', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/f493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/fa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/db4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/21- 2K, 09/22- 6K, 10/23- 11K, 11/24- 12K, 10/25- 13K', 'remarks': 'VOSA STATES 11K, 12K, 13K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b6927eb1-044a-4a77-8b79-72f09af092fa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad09b3e-074f-5da9-b2a1-e1536ed7a017 with identifier: 117539515
2025-11-27 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad09b3e-074f-5da9-b2a1-e1536ed7a017 with scrape type 1
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fb2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117022539, 'registration': 'NG68LXL', 'account': 'SID006', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Longitude 5dr', 'mileage': 42928, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NG68LXL/2025-11-12/image/b9f4ecea-2afd-4d57-977b-26ca3a590d0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/1c902a8f-308c-4d88-97de-506e77b165d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/4837c531-5d0c-4768-8cc1-fbc1567786d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/45e4475c-f521-4366-b35c-35bf345c87c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/d0b65324-7666-4fb2-ac6e-eeecc26fcc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/43ad81f9-9f6b-4ae0-b78e-511d54d5fb21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/941d6a14-2647-4b5e-a08b-d0cde5c66799_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/f339ca05-a50f-4b01-b0c4-4338f185ade8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/c3d744a8-ca79-4165-a34f-a3d809035221_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 9K - 02/21 17K - 03/22 ??', 'remarks': "ODO SHOWS 69087 IN KM'S - VOSA DISCREPANCY, VOSA STATES, 24K, 22K, 35K, 41K - SPARE KEY IN OFFICE", 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd18ac3-6da8-478c-9b2f-85cffd32ccdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117022539, 'registration': 'NG68LXL', 'account': 'SID006', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Longitude 5dr', 'mileage': 42928, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NG68LXL/2025-11-12/image/b9f4ecea-2afd-4d57-977b-26ca3a590d0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/1c902a8f-308c-4d88-97de-506e77b165d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/4837c531-5d0c-4768-8cc1-fbc1567786d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/45e4475c-f521-4366-b35c-35bf345c87c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/d0b65324-7666-4fb2-ac6e-eeecc26fcc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/43ad81f9-9f6b-4ae0-b78e-511d54d5fb21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/941d6a14-2647-4b5e-a08b-d0cde5c66799_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/f339ca05-a50f-4b01-b0c4-4338f185ade8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/c3d744a8-ca79-4165-a34f-a3d809035221_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 9K - 02/21 17K - 03/22 ??', 'remarks': "ODO SHOWS 69087 IN KM'S - VOSA DISCREPANCY, VOSA STATES, 24K, 22K, 35K, 41K - SPARE KEY IN OFFICE", 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd18ac3-6da8-478c-9b2f-85cffd32ccdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-11-27 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with scrape type 2
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with scrape type 2
2025-11-27 19:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6, identifier: 117022539
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117514806, 'registration': 'GL67CYF', 'account': 'GAT002', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '0.9 IG-T Acenta 5dr', 'mileage': 56142, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-12-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26ea1c8e-29de-4080-ac2b-12e5a68756e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117514806, 'registration': 'GL67CYF', 'account': 'GAT002', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '0.9 IG-T Acenta 5dr', 'mileage': 56142, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-12-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26ea1c8e-29de-4080-ac2b-12e5a68756e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aa51639-2b35-5d30-86a5-d96d7256be3c with identifier: 117514806
2025-11-27 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa51639-2b35-5d30-86a5-d96d7256be3c with scrape type 1
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7aa51639-2b35-5d30-86a5-d96d7256be3c
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7aa51639-2b35-5d30-86a5-d96d7256be3c
2025-11-27 19:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7aa51639-2b35-5d30-86a5-d96d7256be3c, identifier: 117514806
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117023522, 'registration': 'YS70PZX', 'account': 'LPK001', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro S Line 5dr S Tronic', 'mileage': 98834, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-12-04', 'fuel': 'Diesel', 'motExpiry': '2025-12-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS70PZX/2025-11-11/image/badca98f-11e3-421a-85f9-8596dca9e9ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/9be31c82-bfcd-44d4-98ee-3632c6891302_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/69f6e28d-b781-45ba-a72b-ea965895ef5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/71d271ef-3bb6-48cc-87d5-78e471ab033f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca15ca06-51b3-4819-94f7-d3cbbdd87e7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca65eb6c-3f51-45e2-90c9-736bd43c1dde_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ee9d1036-3d80-4f62-8b20-b4b11bf2ecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/383276a2-ff75-4048-8562-29b75f590141_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/579a351c-550d-48b7-b102-8f45f1852595_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/df83dd58-634e-477b-9131-c283dcf90331_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 5/21 14K, 11/21 23K, 4/22 31K, 8/22 39K, 11/22 44K, 2/23 47K, 8/23 58K, 12/23 64K, 2/24 67K, 11/24 87K, 6/25 97K', 'remarks': 'VOSA STATES 64K, 87K, SPARE KEY IN OFFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5592c627-e38b-4129-8dc4-4f98f555d4ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117023522, 'registration': 'YS70PZX', 'account': 'LPK001', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro S Line 5dr S Tronic', 'mileage': 98834, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-12-04', 'fuel': 'Diesel', 'motExpiry': '2025-12-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS70PZX/2025-11-11/image/badca98f-11e3-421a-85f9-8596dca9e9ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/9be31c82-bfcd-44d4-98ee-3632c6891302_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/69f6e28d-b781-45ba-a72b-ea965895ef5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/71d271ef-3bb6-48cc-87d5-78e471ab033f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca15ca06-51b3-4819-94f7-d3cbbdd87e7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca65eb6c-3f51-45e2-90c9-736bd43c1dde_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ee9d1036-3d80-4f62-8b20-b4b11bf2ecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/383276a2-ff75-4048-8562-29b75f590141_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/579a351c-550d-48b7-b102-8f45f1852595_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/df83dd58-634e-477b-9131-c283dcf90331_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 5/21 14K, 11/21 23K, 4/22 31K, 8/22 39K, 11/22 44K, 2/23 47K, 8/23 58K, 12/23 64K, 2/24 67K, 11/24 87K, 6/25 97K', 'remarks': 'VOSA STATES 64K, 87K, SPARE KEY IN OFFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5592c627-e38b-4129-8dc4-4f98f555d4ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with identifier: 117023522
2025-11-27 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with scrape type 2
2025-11-27 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with scrape type 2
2025-11-27 19:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 08637a26-6b6d-5217-8eb1-7c440a9fcc73, identifier: 117023522
2025-11-27 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec7aad0>
2025-11-27 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252Fb6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/b6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/da0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/b5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:03:21 [astonbarclay.gb] INFO: Found listing with ID: 117514825
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514825%27 HTTP/1.1" 200 None
2025-11-27 19:03:21 [astonbarclay.gb] INFO: Scrape type for 117514825: 1
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252Fe144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08 with identifier: 116884491
2025-11-27 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08 with identifier: 116884491
2025-11-27 19:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08 with identifier: 116884491 to the API
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27126e0e5c-7b3d-5c8f-ba3c-a0385d926f08%27 HTTP/1.1" 200 None
2025-11-27 19:03:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 126e0e5c-7b3d-5c8f-ba3c-a0385d926f08: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116884491?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '126e0e5c-7b3d-5c8f-ba3c-a0385d926f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DK66OVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116884491',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK SPECIAL EDITIONS',
 'odometer': 72063,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'Auction Plus',
 'title': 'FORD FIESTA HATCHBACK SPECIAL EDITIONS 1.0 EcoBoost Zetec White 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Zetec White 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884491%27 HTTP/1.1" 200 None
2025-11-27 19:03:21 [astonbarclay.gb] INFO: Saving data for 116884491: {'auction_closing_time': 1764331200.0, 'created_time': 1762369346.324532, 'last_price_update_time': 1764270201.774119}
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116884491') HTTP/1.1" 204 0
2025-11-27 19:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5e574254-b04a-502c-8b01-5eb03179ff3e with identifier: 117514835
2025-11-27 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5e574254-b04a-502c-8b01-5eb03179ff3e with identifier: 117514835
2025-11-27 19:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5e574254-b04a-502c-8b01-5eb03179ff3e with identifier: 117514835 to the API
2025-11-27 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275e574254-b04a-502c-8b01-5eb03179ff3e%27 HTTP/1.1" 200 None
2025-11-27 19:03:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5e574254-b04a-502c-8b01-5eb03179ff3e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117514835?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5e574254-b04a-502c-8b01-5eb03179ff3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK20UXC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117514835',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 48111,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seller_name': 'Gates Group',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 125 ST-Line X Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line X Edition 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514835%27 HTTP/1.1" 200 None
2025-11-27 19:03:22 [astonbarclay.gb] INFO: Saving data for 117514835: {'created_time': 1764270202.180247, 'last_price_update_time': 1764270202.180256, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117514835') HTTP/1.1" 204 0
2025-11-27 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-11-27 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-11-27 19:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539 to the API
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117022539?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '01460e64-4cab-5bd2-9fc0-c07e97dc78a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NG68LXL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117022539',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK',
 'odometer': 42928,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seller_name': 'Auction Plus',
 'title': 'JEEP RENEGADE HATCHBACK 1.0 T3 GSE Longitude 5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Longitude 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-11-27 19:03:22 [astonbarclay.gb] INFO: Saving data for 117022539: {'auction_closing_time': 1764331200.0, 'created_time': 1763024481.81059, 'last_price_update_time': 1764270202.498973}
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117022539') HTTP/1.1" 204 0
2025-11-27 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7aa51639-2b35-5d30-86a5-d96d7256be3c with identifier: 117514806
2025-11-27 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7aa51639-2b35-5d30-86a5-d96d7256be3c with identifier: 117514806
2025-11-27 19:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7aa51639-2b35-5d30-86a5-d96d7256be3c with identifier: 117514806 to the API
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277aa51639-2b35-5d30-86a5-d96d7256be3c%27 HTTP/1.1" 200 None
2025-11-27 19:03:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7aa51639-2b35-5d30-86a5-d96d7256be3c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117514806?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7aa51639-2b35-5d30-86a5-d96d7256be3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GL67CYF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117514806',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'MICRA HATCHBACK',
 'odometer': 56142,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': 'Gates Group',
 'title': 'NISSAN MICRA HATCHBACK 0.9 IG-T Acenta 5dr',
 'transmission': 'manual',
 'trim': '0.9 IG-T Acenta 5dr',
 'vin': None,
 'year': 2017}
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514806%27 HTTP/1.1" 200 None
2025-11-27 19:03:22 [astonbarclay.gb] INFO: Saving data for 117514806: {'created_time': 1764270202.869961, 'last_price_update_time': 1764270202.869971, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117514806') HTTP/1.1" 204 0
2025-11-27 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with identifier: 117023522
2025-11-27 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with identifier: 117023522
2025-11-27 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159057
2025-11-27 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 spider: astonbarclay.gb
2025-11-27 19:03:23 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 due to rule: high_mileage_for_country.json, error: 159057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159057
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '08637a26-6b6d-5217-8eb1-7c440a9fcc73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS70PZX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117023522',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q5 DIESEL ESTATE',
 'odometer': 98834,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seller_name': 'Auction Plus',
 'title': 'AUDI Q5 DIESEL ESTATE 40 TDI Quattro S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TDI Quattro S Line 5dr S Tronic',
 'vin': None,
 'year': 2020}
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Saving data for 117023522: {'auction_closing_time': 1764331200.0, 'created_time': 1762844451.154343, 'last_price_update_time': 1764270203.09145}
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117023522') HTTP/1.1" 204 0
2025-11-27 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fb69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117514797
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514797%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117514797: 1
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fc4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117535067?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116918961?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Ff493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/f493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117501383
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117501383%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117501383: 0
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117504223
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117504223%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117504223: 0
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Found listing with ID: 117542115
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542115%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [astonbarclay.gb] INFO: Scrape type for 117542115: 1
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0c710>
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252Fda0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/da0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdfc790>
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec5ee50>
2025-11-27 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fb5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/b5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Ffa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/fa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/eb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117420774
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420774%27 HTTP/1.1" 200 None
2025-11-27 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117420774: 0
2025-11-27 19:03:24 [astonbarclay.gb] INFO: Found listing with ID: 117539643
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539643%27 HTTP/1.1" 200 None
2025-11-27 19:03:24 [astonbarclay.gb] INFO: Scrape type for 117539643: 1
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fb20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec7a750>
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e8384d0>
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feab790>
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117535067, 'registration': 'SF20BKA', 'account': 'SMC009', 'make': 'FORD', 'model': 'TOURNEO CUSTOM 320 TI TDC', 'derivative': None, 'mileage': 55107, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-08-31', 'fuel': 'Diesel', 'motExpiry': '2026-09-05', 'doors': None, 'engineSize': 1995, 'bodyType': 'MPV', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 227, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7762454f-09dd-4b35-92e0-611a63f51db9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117535067, 'registration': 'SF20BKA', 'account': 'SMC009', 'make': 'FORD', 'model': 'TOURNEO CUSTOM 320 TI TDC', 'derivative': None, 'mileage': 55107, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-08-31', 'fuel': 'Diesel', 'motExpiry': '2026-09-05', 'doors': None, 'engineSize': 1995, 'bodyType': 'MPV', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 227, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7762454f-09dd-4b35-92e0-611a63f51db9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c65aaa-a28b-549c-a21f-222f612f656a with identifier: 117535067
2025-11-27 19:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c65aaa-a28b-549c-a21f-222f612f656a with scrape type 1
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 98c65aaa-a28b-549c-a21f-222f612f656a
2025-11-27 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 98c65aaa-a28b-549c-a21f-222f612f656a
2025-11-27 19:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 98c65aaa-a28b-549c-a21f-222f612f656a, identifier: 117535067
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116918961, 'registration': 'LT66KUG', 'account': 'STE097', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0T FSI [230] Quattro S Line Plus 5dr Tip Auto', 'mileage': 92864, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-02', 'fuel': 'Petrol', 'motExpiry': '2026-09-17', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg?w=600', 'https://abimg002.imgix.net/4baaf161-f9ea-4157-bad9-645931aaa989.jpg?w=600', 'https://abimg002.imgix.net/59077cf9-fcf3-415b-835e-08f914a9ceac.jpg?w=600', 'https://abimg002.imgix.net/e761e77a-34a3-45ea-aeb0-d775872730b6.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116918961, 'registration': 'LT66KUG', 'account': 'STE097', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0T FSI [230] Quattro S Line Plus 5dr Tip Auto', 'mileage': 92864, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-02', 'fuel': 'Petrol', 'motExpiry': '2026-09-17', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg?w=600', 'https://abimg002.imgix.net/4baaf161-f9ea-4157-bad9-645931aaa989.jpg?w=600', 'https://abimg002.imgix.net/59077cf9-fcf3-415b-835e-08f914a9ceac.jpg?w=600', 'https://abimg002.imgix.net/e761e77a-34a3-45ea-aeb0-d775872730b6.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive Mini', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad18857-87ac-506f-b7ea-00ccfe7811c9 with identifier: 116918961
2025-11-27 19:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9 with scrape type 1
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg?w=600 not downloaded yet
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e838d90>
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9ee8d0>
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Found listing with ID: 117579407
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579407%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Scrape type for 117579407: 1
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 98c65aaa-a28b-549c-a21f-222f612f656a with identifier: 117535067
2025-11-27 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 98c65aaa-a28b-549c-a21f-222f612f656a with identifier: 117535067
2025-11-27 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom 320 ti tdc' containing 'tourneo'
2025-11-27 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 98c65aaa-a28b-549c-a21f-222f612f656a spider: astonbarclay.gb
2025-11-27 19:03:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 98c65aaa-a28b-549c-a21f-222f612f656a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom 320 ti tdc' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': None,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '98c65aaa-a28b-549c-a21f-222f612f656a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SF20BKA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117535067',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'TOURNEO CUSTOM 320 TI TDC',
 'odometer': 55107,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': 'SMC Group',
 'title': 'FORD TOURNEO CUSTOM 320 TI TDC None',
 'transmission': 'automatic',
 'trim': None,
 'vin': None,
 'year': 2020}
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117535067%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Saving data for 117535067: {'created_time': 1764270205.81584, 'last_price_update_time': 1764270205.815852, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117535067') HTTP/1.1" 204 0
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fdb4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/db4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4baaf161-f9ea-4157-bad9-645931aaa989.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4baaf161-f9ea-4157-bad9-645931aaa989.jpg?w=600 not downloaded yet
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Found listing with ID: 117546439
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546439%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Scrape type for 117546439: 0
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Found listing with ID: 117549056
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549056%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [astonbarclay.gb] INFO: Scrape type for 117549056: 1
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570688?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117310723?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117413519?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117276677?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117357391?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e81a550>
2025-11-27 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252Fe9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80c090>
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fb2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecf0650>
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252Feb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/eb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/fa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252F8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F59077cf9-fcf3-415b-835e-08f914a9ceac.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/59077cf9-fcf3-415b-835e-08f914a9ceac.jpg?w=600 not downloaded yet
2025-11-27 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117488596
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488596%27 HTTP/1.1" 200 None
2025-11-27 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117488596: 0
2025-11-27 19:03:26 [astonbarclay.gb] INFO: Found listing with ID: 117433308
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433308%27 HTTP/1.1" 200 None
2025-11-27 19:03:26 [astonbarclay.gb] INFO: Scrape type for 117433308: 2
2025-11-27 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d15f190>
2025-11-27 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fc4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80d990>
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252F041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe761e77a-34a3-45ea-aeb0-d775872730b6.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e761e77a-34a3-45ea-aeb0-d775872730b6.jpg?w=600 not downloaded yet
2025-11-27 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116918961?view=catalogue)
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Found listing with ID: 117431352
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431352%27 HTTP/1.1" 200 None
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Scrape type for 117431352: 2
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252F3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eacf7d0>
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570688, 'registration': 'BX67NKA', 'account': 'MAN037', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 eD4 SE Tech 5dr 2WD', 'mileage': 105727, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/18 6k- 12/20 21k', 'remarks': 'VOSA STATES 45K - 63K - 80K - 98K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e19f6ac3-ae3a-4917-bfee-bc86352995d8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570688, 'registration': 'BX67NKA', 'account': 'MAN037', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 eD4 SE Tech 5dr 2WD', 'mileage': 105727, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/18 6k- 12/20 21k', 'remarks': 'VOSA STATES 45K - 63K - 80K - 98K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e19f6ac3-ae3a-4917-bfee-bc86352995d8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c63af2-44da-5693-a702-455a85f4faaa with identifier: 117570688
2025-11-27 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c63af2-44da-5693-a702-455a85f4faaa with scrape type 1
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 44c63af2-44da-5693-a702-455a85f4faaa
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 44c63af2-44da-5693-a702-455a85f4faaa
2025-11-27 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 44c63af2-44da-5693-a702-455a85f4faaa, identifier: 117570688
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117310723, 'registration': 'RV66XCX', 'account': 'DAN036', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav]', 'mileage': 51449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-10-08', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV66XCX/2025-11-18/image/fac241cc-cd1e-4326-ae37-1e4752bf270d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/2c96102c-43f7-4f00-879c-4df44221ce0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/c0bb5dde-1c39-410a-b3aa-b6b4a6c2a449_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/0bae5347-7c0f-4b80-be05-1358c4ddeb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/4264a0de-0a27-40c3-b483-f6826872751d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/48720d7f-d38e-4ab0-a768-ac72b358f0fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/21e5f7f0-1074-4bfc-801c-483f61bcb771_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES - 26K, 37K, 49K, 51K', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8c212ee-b852-4f40-b03c-a78097b53574.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117310723, 'registration': 'RV66XCX', 'account': 'DAN036', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav]', 'mileage': 51449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-10-08', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV66XCX/2025-11-18/image/fac241cc-cd1e-4326-ae37-1e4752bf270d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/2c96102c-43f7-4f00-879c-4df44221ce0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/c0bb5dde-1c39-410a-b3aa-b6b4a6c2a449_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/0bae5347-7c0f-4b80-be05-1358c4ddeb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/4264a0de-0a27-40c3-b483-f6826872751d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/48720d7f-d38e-4ab0-a768-ac72b358f0fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/21e5f7f0-1074-4bfc-801c-483f61bcb771_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES - 26K, 37K, 49K, 51K', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8c212ee-b852-4f40-b03c-a78097b53574.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-11-27 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with scrape type 2
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with scrape type 2
2025-11-27 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3e5c1793-1592-51ac-94a1-fc485e5e64b0, identifier: 117310723
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570049, 'registration': 'YC67FUF', 'account': 'MAN037', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.25 GT-line 5dr', 'mileage': 81608, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 09/18 695 MILES 695 08/19 1K - 09/20 3K - 07/21 9K - 02/22 19K - 08/22 29K - 03/23 39K - 09/23 49K - 03/24 59K - 09/24 68K', 'remarks': 'VOSA STATES 29K- 49K - 68K - 79K  - SPARE KEY IN OFFICE- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b59d25df-e1a0-459c-9168-d1662192d033.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570049, 'registration': 'YC67FUF', 'account': 'MAN037', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.25 GT-line 5dr', 'mileage': 81608, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600', 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 09/18 695 MILES 695 08/19 1K - 09/20 3K - 07/21 9K - 02/22 19K - 08/22 29K - 03/23 39K - 09/23 49K - 03/24 59K - 09/24 68K', 'remarks': 'VOSA STATES 29K- 49K - 68K - 79K  - SPARE KEY IN OFFICE- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b59d25df-e1a0-459c-9168-d1662192d033.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049
2025-11-27 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73c9564-91e7-5fdb-b164-eb4f54479e8b with scrape type 1
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Ff1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117413519, 'registration': 'EO18YOW', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4dr Tip Auto', 'mileage': 64827, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-03-14', 'fuel': 'Diesel', 'motExpiry': '2026-01-10', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/EO18YOW/2025-11-26/image/d6bc9d2c-c3dc-4e75-a588-f4602aa0e5ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/e10bb896-98d4-4982-beed-75a37fd99cf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/8f7a6714-845c-4386-8bf9-a3679a030a83_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/7e892519-b824-479c-ba0c-9f64df4a80d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/136c3f4d-0a3e-41df-af1e-3b5bcc01c853_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/e8e38701-2fb8-48c2-9c6a-2a48b64050b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/fc0b8a4e-ed86-4cae-ace1-e07bc4a29c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/0897c9f7-7527-4e47-9035-ee7b7bda2ea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/5b698a6b-ae9c-4776-b25d-13e742a6f3d9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 27K 35K 44K 55K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62b2b591-d4bb-4d7a-aaa9-c194df60cdf3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117413519, 'registration': 'EO18YOW', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'CLA DIESEL COUPE', 'derivative': 'CLA 220d AMG Line 4dr Tip Auto', 'mileage': 64827, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-03-14', 'fuel': 'Diesel', 'motExpiry': '2026-01-10', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/EO18YOW/2025-11-26/image/d6bc9d2c-c3dc-4e75-a588-f4602aa0e5ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/e10bb896-98d4-4982-beed-75a37fd99cf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/8f7a6714-845c-4386-8bf9-a3679a030a83_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/7e892519-b824-479c-ba0c-9f64df4a80d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/136c3f4d-0a3e-41df-af1e-3b5bcc01c853_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/e8e38701-2fb8-48c2-9c6a-2a48b64050b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/fc0b8a4e-ed86-4cae-ace1-e07bc4a29c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/0897c9f7-7527-4e47-9035-ee7b7bda2ea6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18YOW/2025-11-26/image/5b698a6b-ae9c-4776-b25d-13e742a6f3d9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 27K 35K 44K 55K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62b2b591-d4bb-4d7a-aaa9-c194df60cdf3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c2cce6-d425-5b33-a0a9-99045fe2fcbb with identifier: 117413519
2025-11-27 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c2cce6-d425-5b33-a0a9-99045fe2fcbb with scrape type 2
2025-11-27 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c2cce6-d425-5b33-a0a9-99045fe2fcbb with scrape type 2
2025-11-27 19:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 50c2cce6-d425-5b33-a0a9-99045fe2fcbb, identifier: 117413519
2025-11-27 19:03:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117276677, 'registration': 'LP19RXL', 'account': 'SOU037', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC Elite Nav 5dr', 'mileage': 31105, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-22', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP19RXL/2025-11-18/image/7c43d681-7f13-42dc-b0d4-934c44c04ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/51a43a15-b093-41f1-a854-dd2eeae9452b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/21c4de07-50d4-4094-8e4c-d8aa06ba8e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/134999b7-7f0f-4a53-ad71-0d08023791eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/54740b1b-9aba-494a-aafc-636cc0f1a8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/17b6e06a-67c2-4b70-a094-b6f7af3f1fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/c7944ae5-0eba-47da-8f24-2afb0c9957e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/989087b9-4427-436a-a063-fce6611165ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/21-19K 10/22-28K 05/24-30K 05/25-30K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f18308b6-7d41-45ca-b7b9-c0d3823e2c66.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117276677, 'registration': 'LP19RXL', 'account': 'SOU037', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC Elite Nav 5dr', 'mileage': 31105, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-22', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP19RXL/2025-11-18/image/7c43d681-7f13-42dc-b0d4-934c44c04ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/51a43a15-b093-41f1-a854-dd2eeae9452b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/21c4de07-50d4-4094-8e4c-d8aa06ba8e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/134999b7-7f0f-4a53-ad71-0d08023791eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/54740b1b-9aba-494a-aafc-636cc0f1a8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/17b6e06a-67c2-4b70-a094-b6f7af3f1fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/c7944ae5-0eba-47da-8f24-2afb0c9957e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/989087b9-4427-436a-a063-fce6611165ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/21-19K 10/22-28K 05/24-30K 05/25-30K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f18308b6-7d41-45ca-b7b9-c0d3823e2c66.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-11-27 19:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with scrape type 2
2025-11-27 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with scrape type 2
2025-11-27 19:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d, identifier: 117276677
2025-11-27 19:03:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117357391, 'registration': 'MD65ZGJ', 'account': 'ATA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic', 'mileage': 114245, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2025-10-18', 'doors': 4, 'engineSize': 2987, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/e75845a7-ff1e-4d8f-a5d3-1bc426c0f621_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/98787ba9-3b07-4f04-8695-ed791eec5b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/ef17cd06-8ac6-4c1c-aec0-987a18b6213d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/dbe961d9-9a4f-4b4b-93d8-58be6ec87e81_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/39883fdf-758a-4dd8-9db1-6a1fc9460963_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/acdf63f3-e504-41f5-89a9-3a188f05925a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/20ce900a-7cd9-42d9-abff-27aa73e79582_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/80449f7a-12fc-425c-ba18-b693bf618e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/97f3ef64-7d92-41bb-9c7d-806403c7c491_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17 25K - 06/21 68K - 12/21 72K - 12/22 81K - 02/24 95K - 10/24 103K', 'remarks': 'VOSA STATES, 72K, 78K, 91K, 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e05b61b-9d6e-4b66-877b-a23c2fee261c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117357391, 'registration': 'MD65ZGJ', 'account': 'ATA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic', 'mileage': 114245, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2025-10-18', 'doors': 4, 'engineSize': 2987, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/e75845a7-ff1e-4d8f-a5d3-1bc426c0f621_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/98787ba9-3b07-4f04-8695-ed791eec5b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/ef17cd06-8ac6-4c1c-aec0-987a18b6213d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/dbe961d9-9a4f-4b4b-93d8-58be6ec87e81_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/39883fdf-758a-4dd8-9db1-6a1fc9460963_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/acdf63f3-e504-41f5-89a9-3a188f05925a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/20ce900a-7cd9-42d9-abff-27aa73e79582_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/80449f7a-12fc-425c-ba18-b693bf618e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/97f3ef64-7d92-41bb-9c7d-806403c7c491_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17 25K - 06/21 68K - 12/21 72K - 12/22 81K - 02/24 95K - 10/24 103K', 'remarks': 'VOSA STATES, 72K, 78K, 91K, 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e05b61b-9d6e-4b66-877b-a23c2fee261c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-11-27 19:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9926db2-eb01-5575-baac-fcdfc0a1b314 with scrape type 2
2025-11-27 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9926db2-eb01-5575-baac-fcdfc0a1b314 with scrape type 2
2025-11-27 19:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f9926db2-eb01-5575-baac-fcdfc0a1b314, identifier: 117357391
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea30950>
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Ffa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/fa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e939b90>
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea29090>
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eacfb90>
2025-11-27 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:29 [astonbarclay.gb] INFO: Found listing with ID: 117450382
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450382%27 HTTP/1.1" 200 None
2025-11-27 19:03:29 [astonbarclay.gb] INFO: Scrape type for 117450382: 2
2025-11-27 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 44c63af2-44da-5693-a702-455a85f4faaa with identifier: 117570688
2025-11-27 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 44c63af2-44da-5693-a702-455a85f4faaa with identifier: 117570688
2025-11-27 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170150 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170150
2025-11-27 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 44c63af2-44da-5693-a702-455a85f4faaa spider: astonbarclay.gb
2025-11-27 19:03:29 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 44c63af2-44da-5693-a702-455a85f4faaa due to rule: high_mileage_for_country.json, error: 170150 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170150
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '44c63af2-44da-5693-a702-455a85f4faaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BX67NKA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570688',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 105727,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Manamanx Ltd',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 eD4 SE Tech 5dr '
          '2WD',
 'transmission': 'manual',
 'trim': '2.0 eD4 SE Tech 5dr 2WD',
 'vin': None,
 'year': 2017}
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570688%27 HTTP/1.1" 200 None
2025-11-27 19:03:29 [astonbarclay.gb] INFO: Saving data for 117570688: {'created_time': 1764270209.506541, 'last_price_update_time': 1764270209.506553, 'auction_closing_time': 1764610200.0}
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570688') HTTP/1.1" 204 0
2025-11-27 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-11-27 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-11-27 19:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723 to the API
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117310723?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3e5c1793-1592-51ac-94a1-fc485e5e64b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RV66XCX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310723',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 51449,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': 'Local dealer group',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav]',
 'vin': None,
 'year': 2016}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-11-27 19:03:30 [astonbarclay.gb] INFO: Saving data for 117310723: {'auction_closing_time': 1764331200.0, 'created_time': 1763492732.772906, 'last_price_update_time': 1764270210.148461}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117310723') HTTP/1.1" 204 0
2025-11-27 19:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 50c2cce6-d425-5b33-a0a9-99045fe2fcbb with identifier: 117413519
2025-11-27 19:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 50c2cce6-d425-5b33-a0a9-99045fe2fcbb with identifier: 117413519
2025-11-27 19:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 50c2cce6-d425-5b33-a0a9-99045fe2fcbb with identifier: 117413519 to the API
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117413519?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '50c2cce6-d425-5b33-a0a9-99045fe2fcbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO18YOW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117413519',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA DIESEL COUPE',
 'odometer': 64827,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-14',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ CLA DIESEL COUPE CLA 220d AMG Line 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 220d AMG Line 4dr Tip Auto',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117413519%27 HTTP/1.1" 200 None
2025-11-27 19:03:30 [astonbarclay.gb] INFO: Saving data for 117413519: {'auction_closing_time': 1764756000.0, 'created_time': 1764147702.76422, 'last_price_update_time': 1764270210.422542}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117413519') HTTP/1.1" 204 0
2025-11-27 19:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-11-27 19:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-11-27 19:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677 to the API
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117276677?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4a42e05e-1cce-5cf2-8f88-23b89a32ba9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP19RXL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117276677',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA HATCHBACK',
 'odometer': 31105,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': 'Local Dealer Group',
 'title': 'VAUXHALL ASTRA HATCHBACK 1.0T ecoTEC Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.0T ecoTEC Elite Nav 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-11-27 19:03:30 [astonbarclay.gb] INFO: Saving data for 117276677: {'auction_closing_time': 1764331200.0, 'created_time': 1763492979.845664, 'last_price_update_time': 1764270210.71651}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117276677') HTTP/1.1" 204 0
2025-11-27 19:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-11-27 19:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-11-27 19:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183859 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183859
2025-11-27 19:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f9926db2-eb01-5575-baac-fcdfc0a1b314 spider: astonbarclay.gb
2025-11-27 19:03:30 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f9926db2-eb01-5575-baac-fcdfc0a1b314 due to rule: high_mileage_for_country.json, error: 183859 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183859
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f9926db2-eb01-5575-baac-fcdfc0a1b314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MD65ZGJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117357391',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL SALOON',
 'odometer': 114245,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'Auction Plus',
 'title': 'MERCEDES-BENZ E CLASS DIESEL SALOON E350 BlueTEC AMG Night Ed '
          'Premium 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic',
 'vin': None,
 'year': 2015}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-11-27 19:03:30 [astonbarclay.gb] INFO: Saving data for 117357391: {'auction_closing_time': 1764331200.0, 'created_time': 1763665371.217539, 'last_price_update_time': 1764270210.943807}
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117357391') HTTP/1.1" 204 0
2025-11-27 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4baaf161-f9ea-4157-bad9-645931aaa989.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116918961?view=catalogue)
2025-11-27 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/f493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/db4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:30 [astonbarclay.gb] INFO: Found listing with ID: 117543631
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543631%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Scrape type for 117543631: 0
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Found listing with ID: 117424938
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424938%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Scrape type for 117424938: 2
2025-11-27 19:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117544119, 'registration': 'NA25VUV', 'account': 'WBA002', 'make': 'DS', 'model': 'DS 7 DIESEL HATCHBACK', 'derivative': '1.5 BlueHDi Pallas 5dr EAT8', 'mileage': 7100, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NA25VUV/2025-11-27/image/43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/d61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/b9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'BLANK BOOK, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/42dca95b-e5e0-4cbd-b7f8-ec65b3d99c7f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117544119, 'registration': 'NA25VUV', 'account': 'WBA002', 'make': 'DS', 'model': 'DS 7 DIESEL HATCHBACK', 'derivative': '1.5 BlueHDi Pallas 5dr EAT8', 'mileage': 7100, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2025-03-31', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NA25VUV/2025-11-27/image/43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/d61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/b9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'BLANK BOOK, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 146, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/42dca95b-e5e0-4cbd-b7f8-ec65b3d99c7f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71fc40db-f0fe-5599-8920-856cf88a55d0 with identifier: 117544119
2025-11-27 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71fc40db-f0fe-5599-8920-856cf88a55d0 with scrape type 1
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548257, 'registration': 'EX71FHJ', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'TOUAREG DIESEL ESTATE', 'derivative': '3.0 V6 TDI 4Motion Black Edition 5dr Tip Auto', 'mileage': 49097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-02', 'fuel': 'Diesel', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/dc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/af111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/febd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/f5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 14K', 'remarks': 'VOSA STATES 39K, 45K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 218, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/560ad418-fe9c-4fa0-9871-335ecfa44f89.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548257, 'registration': 'EX71FHJ', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'TOUAREG DIESEL ESTATE', 'derivative': '3.0 V6 TDI 4Motion Black Edition 5dr Tip Auto', 'mileage': 49097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-02', 'fuel': 'Diesel', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/dc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/af111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/febd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/f5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/22- 14K', 'remarks': 'VOSA STATES 39K, 45K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 218, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/560ad418-fe9c-4fa0-9871-335ecfa44f89.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db3a1a02-44ed-56f5-841a-0007174e021d with identifier: 117548257
2025-11-27 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db3a1a02-44ed-56f5-841a-0007174e021d with scrape type 1
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Fdc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/dc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fed0390>
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg?w=600 saved to cache
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Fced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e761e77a-34a3-45ea-aeb0-d775872730b6.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116918961?view=catalogue)
2025-11-27 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Found listing with ID: 117517675
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517675%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Scrape type for 117517675: 0
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Found listing with ID: 117554583
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554583%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [astonbarclay.gb] INFO: Scrape type for 117554583: 1
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0a1c90>
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4baaf161-f9ea-4157-bad9-645931aaa989.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4baaf161-f9ea-4157-bad9-645931aaa989.jpg?w=600 saved to cache
2025-11-27 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb07d10>
2025-11-27 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Ff493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/f493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb04950>
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fb69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb83290>
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fb20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9ea2a810>
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0f6d0>
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252Fdb4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/db4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0c8d0>
2025-11-27 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252F852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/59077cf9-fcf3-415b-835e-08f914a9ceac.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116918961?view=catalogue)
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117543930?view=catalogue)
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA70BPV/2025-11-26/image/8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539515?view=catalogue)
2025-11-27 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117554753
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554753%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117554753: 1
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Fd7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/dc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117554715
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554715%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117554715: 1
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Faf111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/af111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117433308?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9aa5d0>
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe761e77a-34a3-45ea-aeb0-d775872730b6.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e761e77a-34a3-45ea-aeb0-d775872730b6.jpg?w=600 saved to cache
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb95a50>
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252F041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:33 [astonbarclay.gb] INFO: Found listing with ID: 117554820
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554820%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [astonbarclay.gb] INFO: Scrape type for 117554820: 1
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Fe1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:34 [astonbarclay.gb] INFO: Found listing with ID: 117554856
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554856%27 HTTP/1.1" 200 None
2025-11-27 19:03:34 [astonbarclay.gb] INFO: Scrape type for 117554856: 1
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Ffebd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/febd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117509153?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579407?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117514797?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fed2d90>
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F59077cf9-fcf3-415b-835e-08f914a9ceac.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/59077cf9-fcf3-415b-835e-08f914a9ceac.jpg?w=600 saved to cache
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9
2025-11-27 19:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ad18857-87ac-506f-b7ea-00ccfe7811c9, skipping ID generation
2025-11-27 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9 with scrape type 1
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2ad18857-87ac-506f-b7ea-00ccfe7811c9 from tracking dictionaries
2025-11-27 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ad18857-87ac-506f-b7ea-00ccfe7811c9 sending to next pipeline
2025-11-27 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2ad18857-87ac-506f-b7ea-00ccfe7811c9, identifier: 116918961
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe09c50>
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252F3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0d0d0>
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKW20DBU%252F2025-11-27%252Fimage%252Fe144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6eec1b7-60b4-5097-b454-91fd41955aab
2025-11-27 19:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6eec1b7-60b4-5097-b454-91fd41955aab, skipping ID generation
2025-11-27 19:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6eec1b7-60b4-5097-b454-91fd41955aab with scrape type 1
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a6eec1b7-60b4-5097-b454-91fd41955aab from tracking dictionaries
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6eec1b7-60b4-5097-b454-91fd41955aab sending to next pipeline
2025-11-27 19:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6eec1b7-60b4-5097-b454-91fd41955aab, identifier: 117543930
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e91b2d0>
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Ff1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd401d0>
2025-11-27 19:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA70BPV%252F2025-11-26%252Fimage%252F8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA70BPV/2025-11-26/image/8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aad09b3e-074f-5da9-b2a1-e1536ed7a017
2025-11-27 19:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aad09b3e-074f-5da9-b2a1-e1536ed7a017, skipping ID generation
2025-11-27 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad09b3e-074f-5da9-b2a1-e1536ed7a017 with scrape type 1
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aad09b3e-074f-5da9-b2a1-e1536ed7a017 from tracking dictionaries
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aad09b3e-074f-5da9-b2a1-e1536ed7a017 sending to next pipeline
2025-11-27 19:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aad09b3e-074f-5da9-b2a1-e1536ed7a017, identifier: 117539515
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee98d0>
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e804b90>
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Fdc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/dc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117433308, 'registration': 'GY68TKE', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line Premium 5dr Auto', 'mileage': 62162, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-11-20', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY68TKE/2025-11-26/image/c4742e18-07be-416e-8191-3be090e45114_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/ffcdfe87-9b13-4dc9-ba80-1e76b7f5690e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/88f4bf9c-fd52-4654-8813-49972b1ce05b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/88f6fad4-8f1b-4936-a79a-36c8c67dbc51_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/76442f22-9343-4717-b514-4a04180e07fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/92710aec-622f-4fe9-9d6d-acfc1760a447_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/5002cb27-1a92-4774-995e-8804e2e7324c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/e8e61ba3-bfe5-41dc-8be6-3e7840a5c799_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/88e8e211-40ef-4f95-bfe3-f1f033526fd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 40K 43K 50K 60K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/70d12517-df1d-4cb4-bb57-1f605217d61d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117433308, 'registration': 'GY68TKE', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line Premium 5dr Auto', 'mileage': 62162, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-11-20', 'fuel': 'Petrol', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY68TKE/2025-11-26/image/c4742e18-07be-416e-8191-3be090e45114_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/ffcdfe87-9b13-4dc9-ba80-1e76b7f5690e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/88f4bf9c-fd52-4654-8813-49972b1ce05b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/88f6fad4-8f1b-4936-a79a-36c8c67dbc51_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/76442f22-9343-4717-b514-4a04180e07fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/92710aec-622f-4fe9-9d6d-acfc1760a447_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/5002cb27-1a92-4774-995e-8804e2e7324c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/e8e61ba3-bfe5-41dc-8be6-3e7840a5c799_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY68TKE/2025-11-26/image/88e8e211-40ef-4f95-bfe3-f1f033526fd5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 40K 43K 50K 60K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/70d12517-df1d-4cb4-bb57-1f605217d61d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40053082-e39b-58c0-86d3-43a4f73533ed with identifier: 117433308
2025-11-27 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40053082-e39b-58c0-86d3-43a4f73533ed with scrape type 2
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40053082-e39b-58c0-86d3-43a4f73533ed with scrape type 2
2025-11-27 19:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 40053082-e39b-58c0-86d3-43a4f73533ed, identifier: 117433308
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2ad18857-87ac-506f-b7ea-00ccfe7811c9 with identifier: 116918961
2025-11-27 19:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2ad18857-87ac-506f-b7ea-00ccfe7811c9 with identifier: 116918961
2025-11-27 19:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2ad18857-87ac-506f-b7ea-00ccfe7811c9 with identifier: 116918961 to the API
2025-11-27 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/59077cf9-fcf3-415b-835e-08f914a9ceac.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2ad18857-87ac-506f-b7ea-00ccfe7811c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT66KUG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116918961',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q5 ESTATE SPECIAL EDITIONS',
 'odometer': 92864,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63371,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/1ecc2606-04c4-41ef-90c5-f2d029e4f8b5.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58223,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/4baaf161-f9ea-4157-bad9-645931aaa989.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49064,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/59077cf9-fcf3-415b-835e-08f914a9ceac.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad18857-87ac-506f-b7ea-00ccfe7811c9/2ad18857-87ac-506f-b7ea-00ccfe7811c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49424,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/e761e77a-34a3-45ea-aeb0-d775872730b6.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-02',
 'seller_name': 'Hedin Automotive Mini',
 'title': 'AUDI Q5 ESTATE SPECIAL EDITIONS 2.0T FSI [230] Quattro S Line Plus '
          '5dr Tip Auto',
 'transmission': 'automatic',
 'trim': '2.0T FSI [230] Quattro S Line Plus 5dr Tip Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116918961%27 HTTP/1.1" 200 None
2025-11-27 19:03:37 [astonbarclay.gb] INFO: Saving data for 116918961: {'created_time': 1764270217.230123, 'last_price_update_time': 1764270217.230133, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116918961') HTTP/1.1" 204 0
2025-11-27 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6eec1b7-60b4-5097-b454-91fd41955aab with identifier: 117543930
2025-11-27 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6eec1b7-60b4-5097-b454-91fd41955aab with identifier: 117543930
2025-11-27 19:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6eec1b7-60b4-5097-b454-91fd41955aab with identifier: 117543930 to the API
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a6eec1b7-60b4-5097-b454-91fd41955aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KW20DBU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117543930',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL COUPE',
 'odometer': 56602,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32534,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/da0dfc35-4437-44e1-a083-1acfa148bc98_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40330,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e9e92151-dbbd-4221-859c-ffddb3a91428_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30809,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/68112b75-9997-4c22-b32e-54de66228c91_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34576,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/e144355d-13df-4b10-8e9c-ffaed6c73171_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47384,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/08fabbff-3e0f-4205-9828-967d820c8f02_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44129,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/4fc19081-6b30-4d56-9261-e463bd74869a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36004,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/8beeb216-1513-4d8e-90e1-8725e4ec83c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50997,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/164a5562-d24f-4edd-88d6-a8e105bcdb3c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6eec1b7-60b4-5097-b454-91fd41955aab/a6eec1b7-60b4-5097-b454-91fd41955aab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44204,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KW20DBU/2025-11-27/image/852a785a-f20c-4a49-9eb5-96a171ef4307_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-29',
 'seller_name': 'UKCGR - Premium',
 'title': 'MERCEDES-BENZ E CLASS DIESEL COUPE E220d AMG Line Premium Plus 2dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220d AMG Line Premium Plus 2dr 9G-Tronic',
 'vin': None,
 'year': 2020}
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543930%27 HTTP/1.1" 200 None
2025-11-27 19:03:37 [astonbarclay.gb] INFO: Saving data for 117543930: {'created_time': 1764270217.564351, 'last_price_update_time': 1764270217.564361, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117543930') HTTP/1.1" 204 0
2025-11-27 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aad09b3e-074f-5da9-b2a1-e1536ed7a017 with identifier: 117539515
2025-11-27 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aad09b3e-074f-5da9-b2a1-e1536ed7a017 with identifier: 117539515
2025-11-27 19:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aad09b3e-074f-5da9-b2a1-e1536ed7a017 with identifier: 117539515 to the API
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EA70BPV/2025-11-26/image/8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'aad09b3e-074f-5da9-b2a1-e1536ed7a017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA70BPV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117539515',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'AYGO HATCHBACK',
 'odometer': 13172,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38007,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b2c4dfb0-3a1a-412d-9f89-c6eeec2e8d89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38497,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b69aeea6-51c1-43e2-93c6-63e27d72d67a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37393,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/f493ff28-8b3d-41d0-a7c2-2218e0e53213_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37338,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/fa37f8c4-4f22-4733-a7ce-eae5af90bc32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50809,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/b20a35c3-728f-4696-a7d1-07c639aa5284_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47496,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/db4a1704-a5f2-4c92-9d68-893131ef059f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52525,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/8ab0bb78-3215-418d-af51-462ac9a024b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53533,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/041b2809-d45a-4db0-98f8-c6ab2e6f3767_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad09b3e-074f-5da9-b2a1-e1536ed7a017/aad09b3e-074f-5da9-b2a1-e1536ed7a017_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64506,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA70BPV/2025-11-26/image/3f0f3311-fbe6-481e-acc2-9490ecb3fd0e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seller_name': 'UKCGR - Premium',
 'title': 'TOYOTA AYGO HATCHBACK 1.0 VVT-i X-Clusiv 5dr x-shift',
 'transmission': 'automatic',
 'trim': '1.0 VVT-i X-Clusiv 5dr x-shift',
 'vin': None,
 'year': 2020}
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539515%27 HTTP/1.1" 200 None
2025-11-27 19:03:37 [astonbarclay.gb] INFO: Saving data for 117539515: {'created_time': 1764270217.942233, 'last_price_update_time': 1764270217.942245, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117539515') HTTP/1.1" 204 0
2025-11-27 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 40053082-e39b-58c0-86d3-43a4f73533ed with identifier: 117433308
2025-11-27 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 40053082-e39b-58c0-86d3-43a4f73533ed with identifier: 117433308
2025-11-27 19:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 40053082-e39b-58c0-86d3-43a4f73533ed with identifier: 117433308 to the API
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117433308?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '40053082-e39b-58c0-86d3-43a4f73533ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY68TKE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117433308',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 62162,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433308%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Saving data for 117433308: {'auction_closing_time': 1764756000.0, 'created_time': 1764147683.969884, 'last_price_update_time': 1764270218.21425}
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117433308') HTTP/1.1" 204 0
2025-11-27 19:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117517722
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517722%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117517722: 0
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117517662
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517662%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117517662: 0
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117517710
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517710%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117517710: 0
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117517631
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517631%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117517631: 0
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117517733
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517733%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117517733: 0
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117517747
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517747%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117517747: 0
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Found listing with ID: 117085521
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085521%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [astonbarclay.gb] INFO: Scrape type for 117085521: 1
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Ff5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/f5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117450382?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd9c490>
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdda290>
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Fced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3e610>
2025-11-27 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb64390>
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd02d90>
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117509153, 'registration': 'LV72XMK', 'account': 'MER167', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 i-MMD Hybrid EX 5dr eCVT', 'mileage': 8300, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-22', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV72XMK/2025-11-26/image/18b355b9-b902-49fc-9080-0ebbe1fa98fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/4c8a595a-d871-47ff-89da-5434a6455412_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/5a040e41-7764-4d66-addc-74c4713ef424_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/789ba36b-bb8f-43b1-8c5c-d4e64b9ef622_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/4b82626d-3644-40dc-b857-a14959aeabe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/9722c576-7c53-4309-ac45-237eaa758e80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/529f59dd-c169-45dc-9971-0019beda1f4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/252c8f36-255e-440c-bcd9-863677fa129e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/f33315c0-37b2-49e2-a3e0-e902f87b1097_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/835cd1d2-c1dd-4e92-9f53-455141d14062_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 8K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/776897ce-9f50-47d5-8a30-af62475e7e89.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117509153, 'registration': 'LV72XMK', 'account': 'MER167', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 i-MMD Hybrid EX 5dr eCVT', 'mileage': 8300, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-22', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-21', 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV72XMK/2025-11-26/image/18b355b9-b902-49fc-9080-0ebbe1fa98fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/4c8a595a-d871-47ff-89da-5434a6455412_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/5a040e41-7764-4d66-addc-74c4713ef424_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/789ba36b-bb8f-43b1-8c5c-d4e64b9ef622_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/4b82626d-3644-40dc-b857-a14959aeabe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/9722c576-7c53-4309-ac45-237eaa758e80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/529f59dd-c169-45dc-9971-0019beda1f4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/252c8f36-255e-440c-bcd9-863677fa129e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/f33315c0-37b2-49e2-a3e0-e902f87b1097_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72XMK/2025-11-26/image/835cd1d2-c1dd-4e92-9f53-455141d14062_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 8K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/776897ce-9f50-47d5-8a30-af62475e7e89.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23baf420-51b2-5a63-b8e2-b572406de17f with identifier: 117509153
2025-11-27 19:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23baf420-51b2-5a63-b8e2-b572406de17f with scrape type 2
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23baf420-51b2-5a63-b8e2-b572406de17f with scrape type 2
2025-11-27 19:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 23baf420-51b2-5a63-b8e2-b572406de17f, identifier: 117509153
2025-11-27 19:03:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579407, 'registration': 'CN02TEN', 'account': 'GAT001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 [112] Bose Personal Edition 5dr', 'mileage': 61840, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-22', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96d29325-25e6-415d-9703-7b01b94b9997.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579407, 'registration': 'CN02TEN', 'account': 'GAT001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 [112] Bose Personal Edition 5dr', 'mileage': 61840, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-11-22', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96d29325-25e6-415d-9703-7b01b94b9997.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6a6a4f-3b50-523d-9335-ec12f0117886 with identifier: 117579407
2025-11-27 19:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6a6a4f-3b50-523d-9335-ec12f0117886 with scrape type 1
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6a6a6a4f-3b50-523d-9335-ec12f0117886
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6a6a6a4f-3b50-523d-9335-ec12f0117886
2025-11-27 19:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6a6a6a4f-3b50-523d-9335-ec12f0117886, identifier: 117579407
2025-11-27 19:03:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117514797, 'registration': 'LS66OVT', 'account': 'GAT002', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic', 'mileage': 80485, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-11-12', 'fuel': 'Diesel', 'motExpiry': '2026-01-31', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04ce38c9-f956-49bd-a47a-c1c173569646.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117514797, 'registration': 'LS66OVT', 'account': 'GAT002', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic', 'mileage': 80485, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-11-12', 'fuel': 'Diesel', 'motExpiry': '2026-01-31', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/04ce38c9-f956-49bd-a47a-c1c173569646.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c with identifier: 117514797
2025-11-27 19:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c with scrape type 1
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c
2025-11-27 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c
2025-11-27 19:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c, identifier: 117514797
2025-11-27 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/af111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:40 [astonbarclay.gb] INFO: Found listing with ID: 117262801
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117262801%27 HTTP/1.1" 200 None
2025-11-27 19:03:40 [astonbarclay.gb] INFO: Scrape type for 117262801: 1
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 23baf420-51b2-5a63-b8e2-b572406de17f with identifier: 117509153
2025-11-27 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 23baf420-51b2-5a63-b8e2-b572406de17f with identifier: 117509153
2025-11-27 19:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 23baf420-51b2-5a63-b8e2-b572406de17f with identifier: 117509153 to the API
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2723baf420-51b2-5a63-b8e2-b572406de17f%27 HTTP/1.1" 200 None
2025-11-27 19:03:40 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 23baf420-51b2-5a63-b8e2-b572406de17f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117509153?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '23baf420-51b2-5a63-b8e2-b572406de17f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV72XMK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117509153',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 8300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-22',
 'seller_name': 'Hedin Automotive',
 'title': 'HONDA CR-V ESTATE 2.0 i-MMD Hybrid EX 5dr eCVT',
 'transmission': 'automatic',
 'trim': '2.0 i-MMD Hybrid EX 5dr eCVT',
 'vin': None,
 'year': 2022}
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509153%27 HTTP/1.1" 200 None
2025-11-27 19:03:40 [astonbarclay.gb] INFO: Saving data for 117509153: {'auction_closing_time': 1764756000.0, 'created_time': 1764147679.578287, 'last_price_update_time': 1764270220.388291}
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117509153') HTTP/1.1" 204 0
2025-11-27 19:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6a6a6a4f-3b50-523d-9335-ec12f0117886 with identifier: 117579407
2025-11-27 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6a6a6a4f-3b50-523d-9335-ec12f0117886 with identifier: 117579407
2025-11-27 19:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6a6a6a4f-3b50-523d-9335-ec12f0117886 with identifier: 117579407 to the API
2025-11-27 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276a6a6a4f-3b50-523d-9335-ec12f0117886%27 HTTP/1.1" 200 None
2025-11-27 19:03:41 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6a6a6a4f-3b50-523d-9335-ec12f0117886: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:41 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117579407?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6a6a6a4f-3b50-523d-9335-ec12f0117886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CN02TEN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579407',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 61840,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'Gates Group',
 'title': 'NISSAN JUKE HATCHBACK 1.6 [112] Bose Personal Edition 5dr',
 'transmission': 'manual',
 'trim': '1.6 [112] Bose Personal Edition 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579407%27 HTTP/1.1" 200 None
2025-11-27 19:03:41 [astonbarclay.gb] INFO: Saving data for 117579407: {'created_time': 1764270221.474563, 'last_price_update_time': 1764270221.474573, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579407') HTTP/1.1" 204 0
2025-11-27 19:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c with identifier: 117514797
2025-11-27 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c with identifier: 117514797
2025-11-27 19:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c with identifier: 117514797 to the API
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c%27 HTTP/1.1" 200 None
2025-11-27 19:03:41 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:41 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117514797?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7f145ad4-4bf7-55e5-bbb3-4ee2f9c40d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS66OVT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117514797',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q5 ESTATE SPECIAL EDITIONS',
 'odometer': 80485,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-12',
 'seller_name': 'Gates Group',
 'title': 'AUDI Q5 ESTATE SPECIAL EDITIONS 2.0 TDI [190] Quattro S Line Plus '
          '5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic',
 'vin': None,
 'year': 2016}
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514797%27 HTTP/1.1" 200 None
2025-11-27 19:03:41 [astonbarclay.gb] INFO: Saving data for 117514797: {'created_time': 1764270221.767826, 'last_price_update_time': 1764270221.767835, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117514797') HTTP/1.1" 204 0
2025-11-27 19:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117431352?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d23f910>
2025-11-27 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Fd7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fed2110>
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/febd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Found listing with ID: 116699879
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699879%27 HTTP/1.1" 200 None
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Scrape type for 116699879: 2
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252Fd61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/d61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549056, 'registration': 'GX22XJT', 'account': 'MER176', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 30167, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-14', 'fuel': 'Petrol', 'motExpiry': '2026-03-27', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg?w=600', 'https://abimg002.imgix.net/7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg?w=600', 'https://abimg002.imgix.net/08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg?w=600', 'https://abimg002.imgix.net/2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg?w=600', 'https://abimg002.imgix.net/db60a4e1-6ab8-414a-93d5-070e6ce10731.jpg?w=600', 'https://abimg002.imgix.net/5d009754-2810-4387-9bbb-0e5975ea695b.jpg?w=600', 'https://abimg002.imgix.net/c95ee6d2-2510-44be-8435-3fc5a8915b50.jpg?w=600', 'https://abimg002.imgix.net/08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg?w=600', 'https://abimg002.imgix.net/b454aa14-d8d5-496d-8028-9facbae5f1cd.jpg?w=600', 'https://abimg002.imgix.net/852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg?w=600', 'https://abimg002.imgix.net/14390625-6024-4354-a128-687d753a8a83.jpg?w=600', 'https://abimg002.imgix.net/ba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg?w=600', 'https://abimg002.imgix.net/002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg?w=600', 'https://abimg002.imgix.net/3d246d9c-26bb-4de7-98a9-308695b4e667.jpg?w=600', 'https://abimg002.imgix.net/62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service print', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549056, 'registration': 'GX22XJT', 'account': 'MER176', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 30167, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-14', 'fuel': 'Petrol', 'motExpiry': '2026-03-27', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg?w=600', 'https://abimg002.imgix.net/7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg?w=600', 'https://abimg002.imgix.net/08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg?w=600', 'https://abimg002.imgix.net/2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg?w=600', 'https://abimg002.imgix.net/db60a4e1-6ab8-414a-93d5-070e6ce10731.jpg?w=600', 'https://abimg002.imgix.net/5d009754-2810-4387-9bbb-0e5975ea695b.jpg?w=600', 'https://abimg002.imgix.net/c95ee6d2-2510-44be-8435-3fc5a8915b50.jpg?w=600', 'https://abimg002.imgix.net/08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg?w=600', 'https://abimg002.imgix.net/b454aa14-d8d5-496d-8028-9facbae5f1cd.jpg?w=600', 'https://abimg002.imgix.net/852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg?w=600', 'https://abimg002.imgix.net/14390625-6024-4354-a128-687d753a8a83.jpg?w=600', 'https://abimg002.imgix.net/ba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg?w=600', 'https://abimg002.imgix.net/002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg?w=600', 'https://abimg002.imgix.net/3d246d9c-26bb-4de7-98a9-308695b4e667.jpg?w=600', 'https://abimg002.imgix.net/62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service print', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14715ba9-8474-5591-9162-f49cb89b6d88 with identifier: 117549056
2025-11-27 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14715ba9-8474-5591-9162-f49cb89b6d88 with scrape type 1
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg?w=600 not downloaded yet
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117542115, 'registration': 'EJ19KXH', 'account': 'WBA002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 78497, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 29K 42K 56K 70K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3040f68-dfc7-4a4b-8943-6280166e2071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117542115, 'registration': 'EJ19KXH', 'account': 'WBA002', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 78497, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-18', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 29K 42K 56K 70K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3040f68-dfc7-4a4b-8943-6280166e2071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115
2025-11-27 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3feb7045-82ed-5742-a0b6-0794db7b4720 with scrape type 1
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117450382, 'registration': 'LY19OAS', 'account': 'MER167', 'make': 'VOLVO', 'model': 'XC90 ESTATE', 'derivative': '2.0 T5 [250] Momentum 5dr AWD Gtron', 'mileage': 79009, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-31', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LY19OAS/2025-11-26/image/83d83377-65cf-46b2-9374-523127600536_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/5e1bc25f-0a38-4ce3-8b69-df18934ea931_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/fa1a000b-46c8-4312-957b-dc757c0f1722_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/1f94663f-b7ba-4f53-962d-33eefffb2350_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/61da1106-f505-444a-a515-7ed17e73d467_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/87a61949-587e-4c71-a20d-7168c75bf61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/d3710f52-3abb-4433-933a-671b6d46b703_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/e83d376e-3bab-4c8d-b9ca-40ee8afc2f5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/75fccb12-92d5-4f55-ba06-999b43d006bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/db8e9608-28ce-4ff5-9f88-3f0d9356247d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 30K 39K 53K 69K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 184, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb9f85a9-3a44-415b-b28a-cea2c4737160.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117450382, 'registration': 'LY19OAS', 'account': 'MER167', 'make': 'VOLVO', 'model': 'XC90 ESTATE', 'derivative': '2.0 T5 [250] Momentum 5dr AWD Gtron', 'mileage': 79009, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-03-31', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LY19OAS/2025-11-26/image/83d83377-65cf-46b2-9374-523127600536_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/5e1bc25f-0a38-4ce3-8b69-df18934ea931_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/fa1a000b-46c8-4312-957b-dc757c0f1722_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/1f94663f-b7ba-4f53-962d-33eefffb2350_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/61da1106-f505-444a-a515-7ed17e73d467_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/87a61949-587e-4c71-a20d-7168c75bf61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/d3710f52-3abb-4433-933a-671b6d46b703_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/e83d376e-3bab-4c8d-b9ca-40ee8afc2f5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/75fccb12-92d5-4f55-ba06-999b43d006bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY19OAS/2025-11-26/image/db8e9608-28ce-4ff5-9f88-3f0d9356247d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 30K 39K 53K 69K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 184, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eb9f85a9-3a44-415b-b28a-cea2c4737160.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f52fe564-a080-5f58-b8d8-ab991ba35216 with identifier: 117450382
2025-11-27 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52fe564-a080-5f58-b8d8-ab991ba35216 with scrape type 2
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f52fe564-a080-5f58-b8d8-ab991ba35216 with scrape type 2
2025-11-27 19:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f52fe564-a080-5f58-b8d8-ab991ba35216, identifier: 117450382
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117539643, 'registration': 'EG68ZZU', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Titanium X 5dr', 'mileage': 61149, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-05', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/b132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/d32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/19-4K 09/20-8K 06/21-8K 02/22-21K 02/23-32K 09/23-39K 11/25-60K', 'remarks': 'SPARE KEY IN  OFFICE, VOSA STATES 21K 32K 42K 58K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117539643, 'registration': 'EG68ZZU', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Titanium X 5dr', 'mileage': 61149, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-02-05', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/b132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/d32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/19-4K 09/20-8K 06/21-8K 02/22-21K 02/23-32K 09/23-39K 11/25-60K', 'remarks': 'SPARE KEY IN  OFFICE, VOSA STATES 21K 32K 42K 58K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e75617cf-2f58-5fe6-af3c-f2feba9462ed with identifier: 117539643
2025-11-27 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e75617cf-2f58-5fe6-af3c-f2feba9462ed with scrape type 1
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80fb90>
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e96c210>
2025-11-27 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e99c310>
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Faf111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/af111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:43 [astonbarclay.gb] INFO: Found listing with ID: 117058008
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058008%27 HTTP/1.1" 200 None
2025-11-27 19:03:43 [astonbarclay.gb] INFO: Scrape type for 117058008: 1
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252Fb9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/b9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f52fe564-a080-5f58-b8d8-ab991ba35216 with identifier: 117450382
2025-11-27 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f52fe564-a080-5f58-b8d8-ab991ba35216 with identifier: 117450382
2025-11-27 19:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f52fe564-a080-5f58-b8d8-ab991ba35216 with identifier: 117450382 to the API
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117450382?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f52fe564-a080-5f58-b8d8-ab991ba35216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY19OAS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117450382',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLVO',
 'model': 'XC90 ESTATE',
 'odometer': 79009,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-30',
 'seller_name': 'Hedin Automotive',
 'title': 'VOLVO XC90 ESTATE 2.0 T5 [250] Momentum 5dr AWD Gtron',
 'transmission': 'automatic',
 'trim': '2.0 T5 [250] Momentum 5dr AWD Gtron',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450382%27 HTTP/1.1" 200 None
2025-11-27 19:03:43 [astonbarclay.gb] INFO: Saving data for 117450382: {'auction_closing_time': 1764756000.0, 'created_time': 1764147706.037417, 'last_price_update_time': 1764270223.731354}
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117450382') HTTP/1.1" 204 0
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea86050>
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252Fe1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e852150>
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec87790>
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117431352, 'registration': 'DS07JON', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 69131, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-12-23', 'fuel': 'Diesel', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DS07JON/2025-11-26/image/13e4d9f2-9e0a-4a76-bda3-2d8c15b67f05_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/090a54d4-17ee-4430-b948-af47c413e7e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/e22dd277-9dd2-4fd7-9971-3ada503f99a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/bef8c00e-dfcf-4180-bdca-8dc3bbdc0839_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/f4ed20b7-3440-4d83-a000-8f3d4fb8e6d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/95b3ac9f-53bf-4c92-97ef-52adb1f423d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/25d95579-1d4d-42c1-88e9-5199cc2d6f56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/726a8237-c8a1-4d39-8902-b62efccdc8c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/1f1b955f-0786-41ed-ab0d-7f838b26c664_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 37K 46K 55K 63K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d617cdcc-4cc0-4b13-a62f-ea80c150f1d2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117431352, 'registration': 'DS07JON', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 69131, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-12-23', 'fuel': 'Diesel', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DS07JON/2025-11-26/image/13e4d9f2-9e0a-4a76-bda3-2d8c15b67f05_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/090a54d4-17ee-4430-b948-af47c413e7e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/e22dd277-9dd2-4fd7-9971-3ada503f99a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/bef8c00e-dfcf-4180-bdca-8dc3bbdc0839_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/f4ed20b7-3440-4d83-a000-8f3d4fb8e6d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/95b3ac9f-53bf-4c92-97ef-52adb1f423d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/25d95579-1d4d-42c1-88e9-5199cc2d6f56_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/726a8237-c8a1-4d39-8902-b62efccdc8c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS07JON/2025-11-26/image/1f1b955f-0786-41ed-ab0d-7f838b26c664_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 37K 46K 55K 63K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d617cdcc-4cc0-4b13-a62f-ea80c150f1d2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec7634e-e2c6-55b3-8dcd-259afd9eb2af with identifier: 117431352
2025-11-27 19:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec7634e-e2c6-55b3-8dcd-259afd9eb2af with scrape type 2
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec7634e-e2c6-55b3-8dcd-259afd9eb2af with scrape type 2
2025-11-27 19:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6ec7634e-e2c6-55b3-8dcd-259afd9eb2af, identifier: 117431352
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/f5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117570049?view=catalogue)
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg?w=600 not downloaded yet
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Ff1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554583?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554820?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6ec7634e-e2c6-55b3-8dcd-259afd9eb2af with identifier: 117431352
2025-11-27 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6ec7634e-e2c6-55b3-8dcd-259afd9eb2af with identifier: 117431352
2025-11-27 19:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6ec7634e-e2c6-55b3-8dcd-259afd9eb2af with identifier: 117431352 to the API
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117431352?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6ec7634e-e2c6-55b3-8dcd-259afd9eb2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS07JON',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117431352',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLC DIESEL ESTATE',
 'odometer': 69131,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-23',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ GLC DIESEL ESTATE GLC 220d 4Matic AMG Line Premium '
          '5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic',
 'vin': None,
 'year': 2016}
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431352%27 HTTP/1.1" 200 None
2025-11-27 19:03:44 [astonbarclay.gb] INFO: Saving data for 117431352: {'auction_closing_time': 1764756000.0, 'created_time': 1764147695.509708, 'last_price_update_time': 1764270224.990669}
2025-11-27 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117431352') HTTP/1.1" 204 0
2025-11-27 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:45 [astonbarclay.gb] INFO: Found listing with ID: 117178728
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178728%27 HTTP/1.1" 200 None
2025-11-27 19:03:45 [astonbarclay.gb] INFO: Scrape type for 117178728: 1
2025-11-27 19:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb853d0>
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Ffebd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/febd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e823050>
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg?w=600 not downloaded yet
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252Fff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:45 [astonbarclay.gb] INFO: Found listing with ID: 117446295
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446295%27 HTTP/1.1" 200 None
2025-11-27 19:03:45 [astonbarclay.gb] INFO: Scrape type for 117446295: 0
2025-11-27 19:03:45 [astonbarclay.gb] INFO: Found listing with ID: 117546383
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546383%27 HTTP/1.1" 200 None
2025-11-27 19:03:45 [astonbarclay.gb] INFO: Scrape type for 117546383: 1
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec6f750>
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdfde90>
2025-11-27 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e92e550>
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252Ff5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/f5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c3507d0>
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYC67FUF%252F2025-11-27%252Fimage%252F19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d73c9564-91e7-5fdb-b164-eb4f54479e8b
2025-11-27 19:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d73c9564-91e7-5fdb-b164-eb4f54479e8b, skipping ID generation
2025-11-27 19:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73c9564-91e7-5fdb-b164-eb4f54479e8b with scrape type 1
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d73c9564-91e7-5fdb-b164-eb4f54479e8b from tracking dictionaries
2025-11-27 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d73c9564-91e7-5fdb-b164-eb4f54479e8b sending to next pipeline
2025-11-27 19:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d73c9564-91e7-5fdb-b164-eb4f54479e8b, identifier: 117570049
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb84450>
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac6dd0>
2025-11-27 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554583, 'registration': 'ST18ZVR', 'account': 'ARN144', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 3dr', 'mileage': 102738, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-16', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 16k, 21k, 34k, 55k, 82k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554583, 'registration': 'ST18ZVR', 'account': 'ARN144', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 3dr', 'mileage': 102738, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-16', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 16k, 21k, 34k, 55k, 82k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346c817c-813b-584f-8d6f-e40192ec10c0 with identifier: 117554583
2025-11-27 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346c817c-813b-584f-8d6f-e40192ec10c0 with scrape type 1
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 346c817c-813b-584f-8d6f-e40192ec10c0
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 346c817c-813b-584f-8d6f-e40192ec10c0
2025-11-27 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 346c817c-813b-584f-8d6f-e40192ec10c0, identifier: 117554583
2025-11-27 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554820, 'registration': 'SB69BYU', 'account': 'ARN185', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S Classic II 5dr', 'mileage': 74535, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-13', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 50k, 59k, 65k, 74k', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554820, 'registration': 'SB69BYU', 'account': 'ARN185', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S Classic II 5dr', 'mileage': 74535, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-13', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 50k, 59k, 65k, 74k', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3306bc2e-4862-5c14-b6e4-76239ce24630 with identifier: 117554820
2025-11-27 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3306bc2e-4862-5c14-b6e4-76239ce24630 with scrape type 1
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3306bc2e-4862-5c14-b6e4-76239ce24630
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3306bc2e-4862-5c14-b6e4-76239ce24630
2025-11-27 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3306bc2e-4862-5c14-b6e4-76239ce24630, identifier: 117554820
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg?w=600 not downloaded yet
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252Ffcffe57a-859f-4590-8798-d17482780969_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049
2025-11-27 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049
2025-11-27 19:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d73c9564-91e7-5fdb-b164-eb4f54479e8b with identifier: 117570049 to the API
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'd73c9564-91e7-5fdb-b164-eb4f54479e8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YC67FUF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570049',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'PICANTO HATCHBACK',
 'odometer': 81608,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33062,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/f1f3abd8-4211-462f-a5b0-b705a0eed2ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36566,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/2eb943bb-7e4b-4ade-a899-5b04f70cadb4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32076,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/ced34744-e26f-43aa-a2e4-8e304106bcea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38153,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/3def4c87-5114-4806-a53e-4c3c2bd9e4dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47060,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/d7d4c8bc-1602-4e8e-92ee-a760756fdb1c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64571,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/0e765aad-b919-4dd2-8388-45554e2617f6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51112,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/e1294769-b32e-49ac-97e7-3514ad22d129_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9564-91e7-5fdb-b164-eb4f54479e8b/d73c9564-91e7-5fdb-b164-eb4f54479e8b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52162,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YC67FUF/2025-11-27/image/19b13a03-ead8-43c9-8990-45f0ff3df8c1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-22',
 'seller_name': 'Manamanx Ltd',
 'title': 'KIA PICANTO HATCHBACK 1.25 GT-line 5dr',
 'transmission': 'manual',
 'trim': '1.25 GT-line 5dr',
 'vin': None,
 'year': 2017}
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570049%27 HTTP/1.1" 200 None
2025-11-27 19:03:47 [astonbarclay.gb] INFO: Saving data for 117570049: {'created_time': 1764270227.883402, 'last_price_update_time': 1764270227.883414, 'auction_closing_time': 1764610200.0}
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570049') HTTP/1.1" 204 0
2025-11-27 19:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 346c817c-813b-584f-8d6f-e40192ec10c0 with identifier: 117554583
2025-11-27 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 346c817c-813b-584f-8d6f-e40192ec10c0 with identifier: 117554583
2025-11-27 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165340 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165340
2025-11-27 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 346c817c-813b-584f-8d6f-e40192ec10c0 spider: astonbarclay.gb
2025-11-27 19:03:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 346c817c-813b-584f-8d6f-e40192ec10c0 due to rule: high_mileage_for_country.json, error: 165340 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165340
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '346c817c-813b-584f-8d6f-e40192ec10c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ST18ZVR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554583',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 102738,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'Arnold Clark',
 'title': 'MINI HATCHBACK 1.5 Cooper II 3dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper II 3dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554583%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Saving data for 117554583: {'created_time': 1764270228.098885, 'last_price_update_time': 1764270228.098891, 'auction_closing_time': 1764842400.0}
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554583') HTTP/1.1" 204 0
2025-11-27 19:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3306bc2e-4862-5c14-b6e4-76239ce24630 with identifier: 117554820
2025-11-27 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3306bc2e-4862-5c14-b6e4-76239ce24630 with identifier: 117554820
2025-11-27 19:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3306bc2e-4862-5c14-b6e4-76239ce24630 with identifier: 117554820 to the API
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273306bc2e-4862-5c14-b6e4-76239ce24630%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3306bc2e-4862-5c14-b6e4-76239ce24630: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:47 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554820?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3306bc2e-4862-5c14-b6e4-76239ce24630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SB69BYU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554820',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 74535,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'MINI HATCHBACK 2.0 Cooper S Classic II 5dr',
 'transmission': 'manual',
 'trim': '2.0 Cooper S Classic II 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554820%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Saving data for 117554820: {'created_time': 1764270228.374587, 'last_price_update_time': 1764270228.374595, 'auction_closing_time': 1764842400.0}
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554820') HTTP/1.1" 204 0
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec75850>
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe13510>
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252F9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548257?view=catalogue)
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/d61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NA25VUV/2025-11-27/image/b9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117544119?view=catalogue)
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Found listing with ID: 117058987
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058987%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Scrape type for 117058987: 1
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fdb60a4e1-6ab8-414a-93d5-070e6ce10731.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/db60a4e1-6ab8-414a-93d5-070e6ce10731.jpg?w=600 not downloaded yet
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Ff40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554715?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117424938?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554856?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554753?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Found listing with ID: 117446284
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446284%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Scrape type for 117446284: 0
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Found listing with ID: 117308707
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117308707%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [astonbarclay.gb] INFO: Scrape type for 117308707: 1
2025-11-27 19:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5d009754-2810-4387-9bbb-0e5975ea695b.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5d009754-2810-4387-9bbb-0e5975ea695b.jpg?w=600 not downloaded yet
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Ff8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:49 [astonbarclay.gb] INFO: Found listing with ID: 116833742
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833742%27 HTTP/1.1" 200 None
2025-11-27 19:03:49 [astonbarclay.gb] INFO: Scrape type for 116833742: 1
2025-11-27 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc95ee6d2-2510-44be-8435-3fc5a8915b50.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c95ee6d2-2510-44be-8435-3fc5a8915b50.jpg?w=600 not downloaded yet
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea00710>
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84cbd0>
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84f2d0>
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71FHJ%252F2025-11-27%252Fimage%252F91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db3a1a02-44ed-56f5-841a-0007174e021d
2025-11-27 19:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db3a1a02-44ed-56f5-841a-0007174e021d, skipping ID generation
2025-11-27 19:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db3a1a02-44ed-56f5-841a-0007174e021d with scrape type 1
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db3a1a02-44ed-56f5-841a-0007174e021d from tracking dictionaries
2025-11-27 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db3a1a02-44ed-56f5-841a-0007174e021d sending to next pipeline
2025-11-27 19:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: db3a1a02-44ed-56f5-841a-0007174e021d, identifier: 117548257
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9e770490>
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e839590>
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252Fd61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/d61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80d550>
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNA25VUV%252F2025-11-27%252Fimage%252Fb9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NA25VUV/2025-11-27/image/b9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71fc40db-f0fe-5599-8920-856cf88a55d0
2025-11-27 19:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71fc40db-f0fe-5599-8920-856cf88a55d0, skipping ID generation
2025-11-27 19:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71fc40db-f0fe-5599-8920-856cf88a55d0 with scrape type 1
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 71fc40db-f0fe-5599-8920-856cf88a55d0 from tracking dictionaries
2025-11-27 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71fc40db-f0fe-5599-8920-856cf88a55d0 sending to next pipeline
2025-11-27 19:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 71fc40db-f0fe-5599-8920-856cf88a55d0, identifier: 117544119
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea68610>
2025-11-27 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg?w=600 saved to cache
2025-11-27 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:03:51 [astonbarclay.gb] INFO: Found listing with ID: 117069859
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117069859%27 HTTP/1.1" 200 None
2025-11-27 19:03:51 [astonbarclay.gb] INFO: Scrape type for 117069859: 1
2025-11-27 19:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: db3a1a02-44ed-56f5-841a-0007174e021d with identifier: 117548257
2025-11-27 19:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: db3a1a02-44ed-56f5-841a-0007174e021d with identifier: 117548257
2025-11-27 19:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: db3a1a02-44ed-56f5-841a-0007174e021d with identifier: 117548257 to the API
2025-11-27 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'db3a1a02-44ed-56f5-841a-0007174e021d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX71FHJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548257',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'TOUAREG DIESEL ESTATE',
 'odometer': 49097,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38198,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/dc9a460b-3111-4fb9-8219-5c69aba246ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/8b5b2252-e0bc-4324-ad70-de3123ac337a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41786,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/5cad57f3-796f-4a75-8c13-c9888399e398_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41950,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/af111816-423e-41d0-9cf0-949e3acbf45f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51882,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/956478d4-6a63-4356-9e16-15e65d55beda_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54354,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/febd7f14-0859-4ee9-97fe-cd70d8fc67f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44336,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/f5578e6f-0e83-4bd4-a3f8-0f5857c33b06_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/745bfb39-6b2f-4af6-a9fb-1e9e3443b3a8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45464,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/91d77ca5-5fb5-40a7-b171-f3cc5813371d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db3a1a02-44ed-56f5-841a-0007174e021d/db3a1a02-44ed-56f5-841a-0007174e021d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71FHJ/2025-11-27/image/66f227e4-a7a4-4b76-8b15-5365a9c78aa3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-02',
 'seller_name': 'UKCGR - Premium',
 'title': 'VOLKSWAGEN TOUAREG DIESEL ESTATE 3.0 V6 TDI 4Motion Black Edition '
          '5dr Tip Auto',
 'transmission': 'automatic',
 'trim': '3.0 V6 TDI 4Motion Black Edition 5dr Tip Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548257%27 HTTP/1.1" 200 None
2025-11-27 19:03:53 [astonbarclay.gb] INFO: Saving data for 117548257: {'created_time': 1764270233.521739, 'last_price_update_time': 1764270233.521748, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548257') HTTP/1.1" 204 0
2025-11-27 19:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 71fc40db-f0fe-5599-8920-856cf88a55d0 with identifier: 117544119
2025-11-27 19:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 71fc40db-f0fe-5599-8920-856cf88a55d0 with identifier: 117544119
2025-11-27 19:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 71fc40db-f0fe-5599-8920-856cf88a55d0 with identifier: 117544119 to the API
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NA25VUV/2025-11-27/image/b9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '71fc40db-f0fe-5599-8920-856cf88a55d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NA25VUV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117544119',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'DS',
 'model': 'DS 7 DIESEL HATCHBACK',
 'odometer': 7100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36465,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/43a8100f-22bc-45ee-ab58-b593fab23be4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34436,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/04cc85c4-386f-4fc6-8cf6-38e23bffe114_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34964,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/3386add1-0dd1-4642-b752-d75b7a5cbb09_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36704,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/12e78a33-3198-4e5b-a7ce-b1d10e9e7233_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35229,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/7687f842-a502-4bf1-82d3-b68666ba923d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55000,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/440ac4ae-245b-4d48-b722-024563cea71b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43879,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/0bbb7480-4193-4704-adc0-2c860859c436_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39813,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/9bc85c8e-f9dc-4593-8909-fcef68618817_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41889,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/d61280ae-12ba-4ecb-8ed4-f8c266b3165a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71fc40db-f0fe-5599-8920-856cf88a55d0/71fc40db-f0fe-5599-8920-856cf88a55d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45649,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NA25VUV/2025-11-27/image/b9d68607-a189-42bd-83d7-b0c80465eb55_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'DS DS 7 DIESEL HATCHBACK 1.5 BlueHDi Pallas 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Pallas 5dr EAT8',
 'vin': None,
 'year': 2025}
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544119%27 HTTP/1.1" 200 None
2025-11-27 19:03:53 [astonbarclay.gb] INFO: Saving data for 117544119: {'created_time': 1764270233.891767, 'last_price_update_time': 1764270233.891776, 'auction_closing_time': 1764756000.0}
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117544119') HTTP/1.1" 204 0
2025-11-27 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg?w=600 not downloaded yet
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Fb132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/b132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554715, 'registration': 'VU68TYP', 'account': 'ARN167', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.6 CRDi Premium 5dr 2WD', 'mileage': 147841, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Diesel', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 56k, 79k, 93k, 116k, 147k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554715, 'registration': 'VU68TYP', 'account': 'ARN167', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.6 CRDi Premium 5dr 2WD', 'mileage': 147841, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Diesel', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 56k, 79k, 93k, 116k, 147k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33083f3e-dc47-5ade-9878-7378b7ffa522 with identifier: 117554715
2025-11-27 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33083f3e-dc47-5ade-9878-7378b7ffa522 with scrape type 1
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 33083f3e-dc47-5ade-9878-7378b7ffa522
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 33083f3e-dc47-5ade-9878-7378b7ffa522
2025-11-27 19:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 33083f3e-dc47-5ade-9878-7378b7ffa522, identifier: 117554715
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117262801, 'registration': 'FV71VZZ', 'account': 'KIN032', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi PHEV 2 5dr DCT', 'mileage': 45033, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-17', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-12-16', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/c26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/d3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/22 9K 11/23 19K 10/14 30K 08/25 40K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00f86164-3ce7-468b-bcb2-cd2a234a8d4d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117262801, 'registration': 'FV71VZZ', 'account': 'KIN032', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi PHEV 2 5dr DCT', 'mileage': 45033, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-17', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-12-16', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/c26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/d3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/22 9K 11/23 19K 10/14 30K 08/25 40K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00f86164-3ce7-468b-bcb2-cd2a234a8d4d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e6b2116-8263-57bd-8298-e6f4075b7ad3 with identifier: 117262801
2025-11-27 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3 with scrape type 1
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117424938, 'registration': 'GK19DYC', 'account': 'MER167', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '0.9 TCE 90 Iconic 5dr', 'mileage': 61119, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK19DYC/2025-11-26/image/b8f443c4-b9d4-4c50-933b-359a00dd075d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/2a86a970-5f3a-4783-a20c-6ee9271846cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/cd8873c7-9309-4c6f-96e8-93f7d4f92798_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/daccba4c-fbd9-4947-863c-aa4e0f7e5c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/47bfec3d-9275-4057-a0e7-59ecd82442f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/89013e52-e2ac-480e-a1cc-3c3e54f18587_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/d164ea61-21d0-48a1-8b58-9010aceaa9f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/c7ca4599-2cd6-4a29-8471-0c996184ac11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/d4499a9b-8ab0-4868-a317-9335c6c8a77a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/d92b8647-5498-46c5-89c0-456f0ebea48c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 32K 38K50K 54K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bef95c1-57bd-4502-8147-eb8e8099f2ff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117424938, 'registration': 'GK19DYC', 'account': 'MER167', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '0.9 TCE 90 Iconic 5dr', 'mileage': 61119, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-03-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK19DYC/2025-11-26/image/b8f443c4-b9d4-4c50-933b-359a00dd075d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/2a86a970-5f3a-4783-a20c-6ee9271846cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/cd8873c7-9309-4c6f-96e8-93f7d4f92798_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/daccba4c-fbd9-4947-863c-aa4e0f7e5c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/47bfec3d-9275-4057-a0e7-59ecd82442f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/89013e52-e2ac-480e-a1cc-3c3e54f18587_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/d164ea61-21d0-48a1-8b58-9010aceaa9f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/c7ca4599-2cd6-4a29-8471-0c996184ac11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/d4499a9b-8ab0-4868-a317-9335c6c8a77a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK19DYC/2025-11-26/image/d92b8647-5498-46c5-89c0-456f0ebea48c_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 32K 38K50K 54K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bef95c1-57bd-4502-8147-eb8e8099f2ff.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d30ec037-26dc-57c9-ad64-8d4cb42e4b72 with identifier: 117424938
2025-11-27 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d30ec037-26dc-57c9-ad64-8d4cb42e4b72 with scrape type 2
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d30ec037-26dc-57c9-ad64-8d4cb42e4b72 with scrape type 2
2025-11-27 19:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d30ec037-26dc-57c9-ad64-8d4cb42e4b72, identifier: 117424938
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554856, 'registration': 'SG69RXV', 'account': 'ARN224', 'make': 'KIA', 'model': 'STONIC ESTATE SPECIAL EDITION', 'derivative': '1.0T GDi Mixx 5dr', 'mileage': 69346, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 28k, 42k, 53k, 65k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554856, 'registration': 'SG69RXV', 'account': 'ARN224', 'make': 'KIA', 'model': 'STONIC ESTATE SPECIAL EDITION', 'derivative': '1.0T GDi Mixx 5dr', 'mileage': 69346, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 28k, 42k, 53k, 65k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 914cf482-8c7b-5654-ad21-5d5f3fbcce40 with identifier: 117554856
2025-11-27 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 914cf482-8c7b-5654-ad21-5d5f3fbcce40 with scrape type 1
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 914cf482-8c7b-5654-ad21-5d5f3fbcce40
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 914cf482-8c7b-5654-ad21-5d5f3fbcce40
2025-11-27 19:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 914cf482-8c7b-5654-ad21-5d5f3fbcce40, identifier: 117554856
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554753, 'registration': 'BV68OMR', 'account': 'ARN185', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '40 TDI Sport 4dr S Tronic', 'mileage': 105103, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-24', 'fuel': 'Diesel', 'motExpiry': '2026-09-02', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 25k, 47k, 65k, 86k, 102k,', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554753, 'registration': 'BV68OMR', 'account': 'ARN185', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '40 TDI Sport 4dr S Tronic', 'mileage': 105103, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-24', 'fuel': 'Diesel', 'motExpiry': '2026-09-02', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 25k, 47k, 65k, 86k, 102k,', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6303b6e8-ffc4-58e6-a975-470f7dd6b56c with identifier: 117554753
2025-11-27 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6303b6e8-ffc4-58e6-a975-470f7dd6b56c with scrape type 1
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6303b6e8-ffc4-58e6-a975-470f7dd6b56c
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6303b6e8-ffc4-58e6-a975-470f7dd6b56c
2025-11-27 19:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6303b6e8-ffc4-58e6-a975-470f7dd6b56c, identifier: 117554753
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117085521, 'registration': 'BG72YRJ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI SE Technology 5dr', 'mileage': 22892, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/dceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/df914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/24-13k, 10/25-21k,', 'remarks': 'SPARE KEY, vosa states 21k,', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/073d7585-43f1-4222-89fa-7d4fe83f433d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117085521, 'registration': 'BG72YRJ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI SE Technology 5dr', 'mileage': 22892, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/dceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/df914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/24-13k, 10/25-21k,', 'remarks': 'SPARE KEY, vosa states 21k,', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/073d7585-43f1-4222-89fa-7d4fe83f433d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922a3ca1-0b8d-5bcb-99be-622117efac00 with identifier: 117085521
2025-11-27 19:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922a3ca1-0b8d-5bcb-99be-622117efac00 with scrape type 1
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252Fdceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/dceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Found listing with ID: 116361929
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116361929%27 HTTP/1.1" 200 None
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Scrape type for 116361929: 2
2025-11-27 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116699879?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 33083f3e-dc47-5ade-9878-7378b7ffa522 with identifier: 117554715
2025-11-27 19:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 33083f3e-dc47-5ade-9878-7378b7ffa522 with identifier: 117554715
2025-11-27 19:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'hyundai tucson diesel estate 1.6 crdi premium 5dr 2wd', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'tucson diesel estate', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 147841, 'odometer_reading_unit': 'mi', 'registration_date': '2018-10-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554715', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.6 crdi premium 5dr 2wd', 'license_plate': 'vu68typ', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 130, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '33083f3e-dc47-5ade-9878-7378b7ffa522', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'hyundai tucson diesel estate', 'sanitized_make': 'hyundai', 'odometer_in_km': 237926}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'diesel',
     'id': '33083f3e-dc47-5ade-9878-7378b7ffa522',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vu68typ',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554715',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai tucson diesel estate',
     'model': 'tucson diesel estate',
     'odometer': 147841,
     'odometer_in_km': 237926,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-10-29',
     'sanitized_make': 'hyundai',
     'seller_name': 'arnold clark',
     'title': 'hyundai tucson diesel estate 1.6 crdi premium 5dr 2wd',
     'transmission': 'manual',
     'trim': '1.6 crdi premium 5dr 2wd',
     'vin': None,
     'year': 2018}
2025-11-27 19:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 33083f3e-dc47-5ade-9878-7378b7ffa522 spider: astonbarclay.gb
2025-11-27 19:03:54 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 33083f3e-dc47-5ade-9878-7378b7ffa522 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'hyundai tucson diesel estate 1.6 crdi premium 5dr 2wd', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'tucson diesel estate', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 147841, 'odometer_reading_unit': 'mi', 'registration_date': '2018-10-29', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554715', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '1.6 crdi premium 5dr 2wd', 'license_plate': 'vu68typ', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 130, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '33083f3e-dc47-5ade-9878-7378b7ffa522', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'hyundai tucson diesel estate', 'sanitized_make': 'hyundai', 'odometer_in_km': 237926}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'diesel',
     'id': '33083f3e-dc47-5ade-9878-7378b7ffa522',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vu68typ',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554715',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai tucson diesel estate',
     'model': 'tucson diesel estate',
     'odometer': 147841,
     'odometer_in_km': 237926,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-10-29',
     'sanitized_make': 'hyundai',
     'seller_name': 'arnold clark',
     'title': 'hyundai tucson diesel estate 1.6 crdi premium 5dr 2wd',
     'transmission': 'manual',
     'trim': '1.6 crdi premium 5dr 2wd',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '33083f3e-dc47-5ade-9878-7378b7ffa522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VU68TYP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554715',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'TUCSON DIESEL ESTATE',
 'odometer': 147841,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': 'Arnold Clark',
 'title': 'HYUNDAI TUCSON DIESEL ESTATE 1.6 CRDi Premium 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 CRDi Premium 5dr 2WD',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554715%27 HTTP/1.1" 200 None
2025-11-27 19:03:54 [astonbarclay.gb] INFO: Saving data for 117554715: {'created_time': 1764270234.856991, 'last_price_update_time': 1764270234.857001, 'auction_closing_time': 1764842400.0}
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554715') HTTP/1.1" 204 0
2025-11-27 19:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d30ec037-26dc-57c9-ad64-8d4cb42e4b72 with identifier: 117424938
2025-11-27 19:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d30ec037-26dc-57c9-ad64-8d4cb42e4b72 with identifier: 117424938
2025-11-27 19:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d30ec037-26dc-57c9-ad64-8d4cb42e4b72 with identifier: 117424938 to the API
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117424938?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd30ec037-26dc-57c9-ad64-8d4cb42e4b72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GK19DYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424938',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'CLIO HATCHBACK',
 'odometer': 61119,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': 'Hedin Automotive',
 'title': 'RENAULT CLIO HATCHBACK 0.9 TCE 90 Iconic 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Iconic 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424938%27 HTTP/1.1" 200 None
2025-11-27 19:03:55 [astonbarclay.gb] INFO: Saving data for 117424938: {'auction_closing_time': 1764756000.0, 'created_time': 1764147689.121351, 'last_price_update_time': 1764270235.240761}
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117424938') HTTP/1.1" 204 0
2025-11-27 19:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 914cf482-8c7b-5654-ad21-5d5f3fbcce40 with identifier: 117554856
2025-11-27 19:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 914cf482-8c7b-5654-ad21-5d5f3fbcce40 with identifier: 117554856
2025-11-27 19:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 914cf482-8c7b-5654-ad21-5d5f3fbcce40 with identifier: 117554856 to the API
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27914cf482-8c7b-5654-ad21-5d5f3fbcce40%27 HTTP/1.1" 200 None
2025-11-27 19:03:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 914cf482-8c7b-5654-ad21-5d5f3fbcce40: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:03:55 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554856?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '914cf482-8c7b-5654-ad21-5d5f3fbcce40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SG69RXV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554856',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'KIA',
 'model': 'STONIC ESTATE SPECIAL EDITION',
 'odometer': 69346,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-01',
 'seller_name': 'Arnold Clark',
 'title': 'KIA STONIC ESTATE SPECIAL EDITION 1.0T GDi Mixx 5dr',
 'transmission': 'manual',
 'trim': '1.0T GDi Mixx 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554856%27 HTTP/1.1" 200 None
2025-11-27 19:03:55 [astonbarclay.gb] INFO: Saving data for 117554856: {'created_time': 1764270235.53137, 'last_price_update_time': 1764270235.53138, 'auction_closing_time': 1764842400.0}
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554856') HTTP/1.1" 204 0
2025-11-27 19:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6303b6e8-ffc4-58e6-a975-470f7dd6b56c with identifier: 117554753
2025-11-27 19:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6303b6e8-ffc4-58e6-a975-470f7dd6b56c with identifier: 117554753
2025-11-27 19:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169146 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169146
2025-11-27 19:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6303b6e8-ffc4-58e6-a975-470f7dd6b56c spider: astonbarclay.gb
2025-11-27 19:03:55 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6303b6e8-ffc4-58e6-a975-470f7dd6b56c due to rule: high_mileage_for_country.json, error: 169146 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169146
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6303b6e8-ffc4-58e6-a975-470f7dd6b56c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV68OMR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554753',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'AUDI',
 'model': 'A6 DIESEL SALOON',
 'odometer': 105103,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-24',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'AUDI A6 DIESEL SALOON 40 TDI Sport 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TDI Sport 4dr S Tronic',
 'vin': None,
 'year': 2018}
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554753%27 HTTP/1.1" 200 None
2025-11-27 19:03:55 [astonbarclay.gb] INFO: Saving data for 117554753: {'created_time': 1764270235.758053, 'last_price_update_time': 1764270235.758061, 'auction_closing_time': 1764842400.0}
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554753') HTTP/1.1" 204 0
2025-11-27 19:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb462d0>
2025-11-27 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252Fff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecd0150>
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252Ffcffe57a-859f-4590-8798-d17482780969_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb454aa14-d8d5-496d-8028-9facbae5f1cd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b454aa14-d8d5-496d-8028-9facbae5f1cd.jpg?w=600 not downloaded yet
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252Ff85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fbf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:56 [astonbarclay.gb] INFO: Found listing with ID: 116963745
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116963745%27 HTTP/1.1" 200 None
2025-11-27 19:03:56 [astonbarclay.gb] INFO: Scrape type for 116963745: 2
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb58390>
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea605d0>
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e83f710>
2025-11-27 19:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84b310>
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Ff1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb59050>
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252F5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg?w=600 not downloaded yet
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Fd32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/d32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec2d990>
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e918b10>
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg?w=600 saved to cache
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea860d0>
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg?w=600 saved to cache
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb66890>
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg?w=600 saved to cache
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:03:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117058008, 'registration': 'GY73WWA', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 350 4M 215kW AMG Line Premium 66.5kWh 5dr Auto', 'mileage': 19560, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-07', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-9k, 10/25-24k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14f1ba9c-f972-4f83-8f04-1e321ebf8f4c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117058008, 'registration': 'GY73WWA', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 350 4M 215kW AMG Line Premium 66.5kWh 5dr Auto', 'mileage': 19560, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-11-07', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-9k, 10/25-24k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14f1ba9c-f972-4f83-8f04-1e321ebf8f4c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a551e8-f00a-5551-8a26-b32f63a407e3 with identifier: 117058008
2025-11-27 19:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a551e8-f00a-5551-8a26-b32f63a407e3 with scrape type 1
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116699879, 'registration': 'OE72XSD', 'account': 'KIN032', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '300kW 78kWh Long Range DM [Plus] 5dr 4WD Auto', 'mileage': 72681, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-13', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE72XSD/2025-11-05/image/cbc4bf1a-5e2f-4532-aad0-de82be6196df_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/08c03fe4-0419-4b77-8327-f23cafe02be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/9639e1fd-ca09-4369-b888-64b56f5c1e2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/80087817-1216-45e2-ba84-eb3302681f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/916475f5-9f74-435a-9a02-00d83f4ad2b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/e40b952e-3c7e-45e6-a398-0341be75d94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/41d9b662-5163-46cd-a7c4-2c4d3d6e6e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/b2e02acd-abbf-4e07-8a0c-476c2fe30a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/4c7fbb6e-4433-4819-a75b-acf6f08dc0bb_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23-18K 04/24-36K 04/25-57K', 'remarks': 'SPARE FOB, Metallic - Magnesium, 19"" 5 V Spoke black diamond cut alloy wheels / Weave Tech cloth - Plus pack - Slate with black ash decor', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc203d5d-a026-49b8-97de-c578b7374edb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116699879, 'registration': 'OE72XSD', 'account': 'KIN032', 'make': 'POLESTAR', 'model': '2 FASTBACK', 'derivative': '300kW 78kWh Long Range DM [Plus] 5dr 4WD Auto', 'mileage': 72681, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-13', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OE72XSD/2025-11-05/image/cbc4bf1a-5e2f-4532-aad0-de82be6196df_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/08c03fe4-0419-4b77-8327-f23cafe02be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/9639e1fd-ca09-4369-b888-64b56f5c1e2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/80087817-1216-45e2-ba84-eb3302681f32_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/916475f5-9f74-435a-9a02-00d83f4ad2b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/e40b952e-3c7e-45e6-a398-0341be75d94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/41d9b662-5163-46cd-a7c4-2c4d3d6e6e79_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/b2e02acd-abbf-4e07-8a0c-476c2fe30a27_removebg.jpg?w=600', 'https://abimg003.imgix.net/OE72XSD/2025-11-05/image/4c7fbb6e-4433-4819-a75b-acf6f08dc0bb_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23-18K 04/24-36K 04/25-57K', 'remarks': 'SPARE FOB, Metallic - Magnesium, 19"" 5 V Spoke black diamond cut alloy wheels / Weave Tech cloth - Plus pack - Slate with black ash decor', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc203d5d-a026-49b8-97de-c578b7374edb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a69f60a-a505-5e00-a005-d6ae53a5031d with identifier: 116699879
2025-11-27 19:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a69f60a-a505-5e00-a005-d6ae53a5031d with scrape type 2
2025-11-27 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a69f60a-a505-5e00-a005-d6ae53a5031d with scrape type 2
2025-11-27 19:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7a69f60a-a505-5e00-a005-d6ae53a5031d, identifier: 116699879
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:59 [astonbarclay.gb] INFO: Found listing with ID: 116772841
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116772841%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [astonbarclay.gb] INFO: Scrape type for 116772841: 1
2025-11-27 19:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7a69f60a-a505-5e00-a005-d6ae53a5031d with identifier: 116699879
2025-11-27 19:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7a69f60a-a505-5e00-a005-d6ae53a5031d with identifier: 116699879
2025-11-27 19:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'polestar 2 fastback 300kw 78kwh long range dm [plus] 5dr 4wd auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 72681, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699879', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '300kw 78kwh long range dm [plus] 5dr 4wd auto', 'license_plate': 'oe72xsd', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7a69f60a-a505-5e00-a005-d6ae53a5031d', 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 116968}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '7a69f60a-a505-5e00-a005-d6ae53a5031d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe72xsd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699879',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 72681,
     'odometer_in_km': 116968,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-13',
     'sanitized_make': 'polestar',
     'seller_name': 'kinto',
     'title': 'polestar 2 fastback 300kw 78kwh long range dm [plus] 5dr '
              '4wd auto',
     'transmission': 'automatic',
     'trim': '300kw 78kwh long range dm [plus] 5dr 4wd auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 7a69f60a-a505-5e00-a005-d6ae53a5031d spider: astonbarclay.gb
2025-11-27 19:03:59 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7a69f60a-a505-5e00-a005-d6ae53a5031d due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'polestar 2 fastback 300kw 78kwh long range dm [plus] 5dr 4wd auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 72681, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699879', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '300kw 78kwh long range dm [plus] 5dr 4wd auto', 'license_plate': 'oe72xsd', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '7a69f60a-a505-5e00-a005-d6ae53a5031d', 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 116968}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '7a69f60a-a505-5e00-a005-d6ae53a5031d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe72xsd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699879',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 72681,
     'odometer_in_km': 116968,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-13',
     'sanitized_make': 'polestar',
     'seller_name': 'kinto',
     'title': 'polestar 2 fastback 300kw 78kwh long range dm [plus] 5dr '
              '4wd auto',
     'transmission': 'automatic',
     'trim': '300kw 78kwh long range dm [plus] 5dr 4wd auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '7a69f60a-a505-5e00-a005-d6ae53a5031d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OE72XSD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116699879',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'POLESTAR',
 'model': '2 FASTBACK',
 'odometer': 72681,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seller_name': 'Kinto',
 'title': 'POLESTAR 2 FASTBACK 300kW 78kWh Long Range DM [Plus] 5dr 4WD Auto',
 'transmission': 'automatic',
 'trim': '300kW 78kWh Long Range DM [Plus] 5dr 4WD Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699879%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [astonbarclay.gb] INFO: Saving data for 116699879: {'auction_closing_time': 1764842400.0, 'created_time': 1763147121.092036, 'last_price_update_time': 1764270239.385134}
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116699879') HTTP/1.1" 204 0
2025-11-27 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd78bd0>
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Ff8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg?w=600 saved to cache
2025-11-27 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/dceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/b132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c95ee6d2-2510-44be-8435-3fc5a8915b50.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5d009754-2810-4387-9bbb-0e5975ea695b.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F14390625-6024-4354-a128-687d753a8a83.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/14390625-6024-4354-a128-687d753a8a83.jpg?w=600 not downloaded yet
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117546383?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:03:59 [astonbarclay.gb] INFO: Found listing with ID: 116280997
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116280997%27 HTTP/1.1" 200 None
2025-11-27 19:03:59 [astonbarclay.gb] INFO: Scrape type for 116280997: 2
2025-11-27 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0a2250>
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg?w=600 not downloaded yet
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252Fdf914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/df914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e91e610>
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fefda90>
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e91c5d0>
2025-11-27 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Ff40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:04:01 [astonbarclay.gb] INFO: Found listing with ID: 117424159
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424159%27 HTTP/1.1" 200 None
2025-11-27 19:04:01 [astonbarclay.gb] INFO: Scrape type for 117424159: 1
2025-11-27 19:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea84690>
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fea8750>
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252Fdceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/dceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec32990>
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Fb132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/b132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d167590>
2025-11-27 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc95ee6d2-2510-44be-8435-3fc5a8915b50.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c95ee6d2-2510-44be-8435-3fc5a8915b50.jpg?w=600 saved to cache
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee8450>
2025-11-27 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5d009754-2810-4387-9bbb-0e5975ea695b.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5d009754-2810-4387-9bbb-0e5975ea695b.jpg?w=600 saved to cache
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/d32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539643?view=catalogue)
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg?w=600 not downloaded yet
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fc26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/c26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117546383, 'registration': 'DS16ZDP', 'account': 'KEN008', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '2.0 CRDi GT-Line 5dr [AWD]', 'mileage': 48371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-05', 'fuel': 'Diesel', 'motExpiry': '2026-06-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 18k 23k 24k 27k 34k 39k 45k', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117546383, 'registration': 'DS16ZDP', 'account': 'KEN008', 'make': 'KIA', 'model': 'SPORTAGE DIESEL ESTATE', 'derivative': '2.0 CRDi GT-Line 5dr [AWD]', 'mileage': 48371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-05', 'fuel': 'Diesel', 'motExpiry': '2026-06-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 18k 23k 24k 27k 34k 39k 45k', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f with identifier: 117546383
2025-11-27 19:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f with scrape type 1
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f
2025-11-27 19:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f, identifier: 117546383
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117058987, 'registration': 'GU72VHR', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 35708, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Electric', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-14k, 10/24-29k, 10/25-35k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96180d8f-1d78-41b5-bc06-1db9a99a7ee2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117058987, 'registration': 'GU72VHR', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 35708, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Electric', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-14k, 10/24-29k, 10/25-35k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96180d8f-1d78-41b5-bc06-1db9a99a7ee2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac040797-1bbe-5a68-a3ef-1b65270586ce with identifier: 117058987
2025-11-27 19:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac040797-1bbe-5a68-a3ef-1b65270586ce with scrape type 1
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117178728, 'registration': 'RV23WKU', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 250+ 140kW AMG Line 70.5kWh 5dr Auto', 'mileage': 33062, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/24-17k, 07/25-30k,', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ac82752-9e7c-4605-9875-ebc3be6ab90d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117178728, 'registration': 'RV23WKU', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 250+ 140kW AMG Line 70.5kWh 5dr Auto', 'mileage': 33062, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-18', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 08/24-17k, 07/25-30k,', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ac82752-9e7c-4605-9875-ebc3be6ab90d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19c841b-07b1-5c88-906d-93070ec020ce with identifier: 117178728
2025-11-27 19:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c841b-07b1-5c88-906d-93070ec020ce with scrape type 1
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117514825, 'registration': 'EJ22HJX', 'account': 'GAT002', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.5 EcoBoost ST 5dr', 'mileage': 28377, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/c64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/de20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/059497c0-41eb-4555-a73d-21c401943806_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce222340-102d-497d-8671-9f6f352e878a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117514825, 'registration': 'EJ22HJX', 'account': 'GAT002', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.5 EcoBoost ST 5dr', 'mileage': 28377, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/c64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/de20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/059497c0-41eb-4555-a73d-21c401943806_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 148, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce222340-102d-497d-8671-9f6f352e878a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875f4b54-74f2-5b45-9e72-d1456fa71be5 with identifier: 117514825
2025-11-27 19:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875f4b54-74f2-5b45-9e72-d1456fa71be5 with scrape type 1
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b454aa14-d8d5-496d-8028-9facbae5f1cd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Found listing with ID: 117024845
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024845%27 HTTP/1.1" 200 None
2025-11-27 19:04:02 [astonbarclay.gb] INFO: Scrape type for 117024845: 2
2025-11-27 19:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f with identifier: 117546383
2025-11-27 19:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f with identifier: 117546383
2025-11-27 19:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f with identifier: 117546383 to the API
2025-11-27 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27266f7318-92b8-5c95-ad73-2e6ebfbe7e2f%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 266f7318-92b8-5c95-ad73-2e6ebfbe7e2f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117546383?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '266f7318-92b8-5c95-ad73-2e6ebfbe7e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS16ZDP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117546383',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'KIA',
 'model': 'SPORTAGE DIESEL ESTATE',
 'odometer': 48371,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': 'Ken Jervis Kia',
 'title': 'KIA SPORTAGE DIESEL ESTATE 2.0 CRDi GT-Line 5dr [AWD]',
 'transmission': 'manual',
 'trim': '2.0 CRDi GT-Line 5dr [AWD]',
 'vin': None,
 'year': 2016}
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546383%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [astonbarclay.gb] INFO: Saving data for 117546383: {'created_time': 1764270243.167519, 'last_price_update_time': 1764270243.167529, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117546383') HTTP/1.1" 204 0
2025-11-27 19:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3d246d9c-26bb-4de7-98a9-308695b4e667.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3d246d9c-26bb-4de7-98a9-308695b4e667.jpg?w=600 not downloaded yet
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fd3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/d3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fefc210>
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd03250>
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252F18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaf1610>
2025-11-27 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fbf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:04:04 [astonbarclay.gb] INFO: Found listing with ID: 117264969
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117264969%27 HTTP/1.1" 200 None
2025-11-27 19:04:04 [astonbarclay.gb] INFO: Scrape type for 117264969: 1
2025-11-27 19:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecb7710>
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb5a050>
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecb68d0>
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e99f9d0>
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eca2290>
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEG68ZZU%252F2025-11-27%252Fimage%252Fd32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/d32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e75617cf-2f58-5fe6-af3c-f2feba9462ed
2025-11-27 19:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e75617cf-2f58-5fe6-af3c-f2feba9462ed, skipping ID generation
2025-11-27 19:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e75617cf-2f58-5fe6-af3c-f2feba9462ed with scrape type 1
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e75617cf-2f58-5fe6-af3c-f2feba9462ed from tracking dictionaries
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e75617cf-2f58-5fe6-af3c-f2feba9462ed sending to next pipeline
2025-11-27 19:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e75617cf-2f58-5fe6-af3c-f2feba9462ed, identifier: 117539643
2025-11-27 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/df914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:04:05 [scrapy.extensions.logstats] INFO: Crawled 224 pages (at 44 pages/min), scraped 157 items (at 33 items/min)
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg?w=600 not downloaded yet
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fbbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252Fcfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252Fc64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/c64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e75617cf-2f58-5fe6-af3c-f2feba9462ed with identifier: 117539643
2025-11-27 19:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e75617cf-2f58-5fe6-af3c-f2feba9462ed with identifier: 117539643
2025-11-27 19:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e75617cf-2f58-5fe6-af3c-f2feba9462ed with identifier: 117539643 to the API
2025-11-27 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/d32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e75617cf-2f58-5fe6-af3c-f2feba9462ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EG68ZZU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117539643',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS DIESEL ESTATE',
 'odometer': 61149,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32845,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/5eefaff8-3095-432f-8f9a-0a12d7d1c673_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32221,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f1c08918-d272-4127-9195-9bdc15dfa5c5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36116,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/2a02880f-337e-4deb-8205-175b5f0c111f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34022,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/6e67cb8f-06c3-4eb3-b4e9-6c85cf9d408c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52179,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f40afd80-8165-4a0c-8f1f-c0daff08b747_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44125,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/f8aea686-46a5-44b6-b449-24a4c9ae2016_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51657,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/106a598b-8bfd-4be5-b96d-ad790419240c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56873,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/b132b4eb-d7b1-4bbc-b0fe-634cb5287932_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49364,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/18656ff6-8069-4222-a724-b662577d19aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e75617cf-2f58-5fe6-af3c-f2feba9462ed/e75617cf-2f58-5fe6-af3c-f2feba9462ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56878,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EG68ZZU/2025-11-27/image/d32621dc-f3cf-4319-9b5d-24e526c41326_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-05',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD FOCUS DIESEL ESTATE 1.5 EcoBlue 120 Titanium X 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue 120 Titanium X 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539643%27 HTTP/1.1" 200 None
2025-11-27 19:04:06 [astonbarclay.gb] INFO: Saving data for 117539643: {'created_time': 1764270246.160381, 'last_price_update_time': 1764270246.160391, 'auction_closing_time': 1764756000.0}
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117539643') HTTP/1.1" 204 0
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fddb690>
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg?w=600 saved to cache
2025-11-27 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaef110>
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb454aa14-d8d5-496d-8028-9facbae5f1cd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b454aa14-d8d5-496d-8028-9facbae5f1cd.jpg?w=600 saved to cache
2025-11-27 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:04:06 [astonbarclay.gb] INFO: Found listing with ID: 116183620
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116183620%27 HTTP/1.1" 200 None
2025-11-27 19:04:06 [astonbarclay.gb] INFO: Scrape type for 116183620: 2
2025-11-27 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116963745?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece0950>
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252Ff85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252Fae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e83b310>
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd406d0>
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:04:07 [astonbarclay.gb] INFO: Found listing with ID: 117099256
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099256%27 HTTP/1.1" 200 None
2025-11-27 19:04:07 [astonbarclay.gb] INFO: Scrape type for 117099256: 1
2025-11-27 19:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80a210>
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_10.jpg HTTP/1.1" 201 0
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e8278d0>
2025-11-27 19:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84f810>
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252Fdf914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/df914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e962550>
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_11.jpg HTTP/1.1" 201 0
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg?w=600 saved to cache
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e808510>
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e92e310>
2025-11-27 19:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252F6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/d3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252Ff226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F441c359c-b89d-468a-b444-432c4329164d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252Ff47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117308707, 'registration': 'VN72BBX', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 110 SE 5dr', 'mileage': 23949, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-16', 'fuel': 'Petrol', 'motExpiry': '2026-11-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN72BBX/2025-11-19/image/69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/d201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/c5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/a87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24-14K', 'remarks': 'SPARE KEY, VOSA STATES 23K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/385b48d3-5044-4df5-847e-08bd7b858c26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117308707, 'registration': 'VN72BBX', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'T-CROSS ESTATE', 'derivative': '1.0 TSI 110 SE 5dr', 'mileage': 23949, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-16', 'fuel': 'Petrol', 'motExpiry': '2026-11-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN72BBX/2025-11-19/image/69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/d201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/c5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/a87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24-14K', 'remarks': 'SPARE KEY, VOSA STATES 23K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/385b48d3-5044-4df5-847e-08bd7b858c26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a768b5c-1acf-5b22-87a5-fd9d61edba48 with identifier: 117308707
2025-11-27 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48 with scrape type 1
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117069859, 'registration': 'FX72PXU', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line Premium Plus 80kWh 5dr Auto', 'mileage': 42317, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-24', 'fuel': 'Electric', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 13K 10/24 26K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/419bcd58-f03b-44ad-a26b-07897232ee24.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117069859, 'registration': 'FX72PXU', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line Premium Plus 80kWh 5dr Auto', 'mileage': 42317, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-24', 'fuel': 'Electric', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 13K 10/24 26K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/419bcd58-f03b-44ad-a26b-07897232ee24.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414a6ee5-291d-5d14-b2af-24f35cba14fb with identifier: 117069859
2025-11-27 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414a6ee5-291d-5d14-b2af-24f35cba14fb with scrape type 1
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116772841, 'registration': 'GY72DGF', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 24386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-25', 'fuel': 'Electric', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23-9K 09/24-17K 10/25-24K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/30d49177-6cfb-4271-b362-49f9ce74e657.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116772841, 'registration': 'GY72DGF', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 24386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-25', 'fuel': 'Electric', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23-9K 09/24-17K 10/25-24K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/30d49177-6cfb-4271-b362-49f9ce74e657.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00f77c2c-04c7-556e-93e9-f161290a6916 with identifier: 116772841
2025-11-27 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f77c2c-04c7-556e-93e9-f161290a6916 with scrape type 1
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252F8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116963745, 'registration': 'RE22UKT', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 26943, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-04-10', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UKT/2025-11-10/image/a9db748d-108d-4e3f-91f8-4c7b0895e062_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/b439a09d-910a-4614-9ad7-4853a2eb1e54_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/38bb74ab-faf8-4b59-96ae-f09bcec21362_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/0d6d3e75-1323-42e9-9a88-30a508b3b30e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/567c6ec8-ab1c-4391-a179-0964a672ca96_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/1c73e968-5846-436b-b796-57641c7e1cfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/f002c7ab-03d7-4469-bd80-f7a50f480979_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/4c01683b-bdd0-4672-b434-e3bc571cb634_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 03/24-16K', 'remarks': 'SPARE KEY, VOSA STATES 24K, Metallic - Reflex silver, Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae4958bd-3669-49e3-9bb1-a58eb86f3bc8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116963745, 'registration': 'RE22UKT', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 26943, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-04-10', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UKT/2025-11-10/image/a9db748d-108d-4e3f-91f8-4c7b0895e062_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/b439a09d-910a-4614-9ad7-4853a2eb1e54_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/38bb74ab-faf8-4b59-96ae-f09bcec21362_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/0d6d3e75-1323-42e9-9a88-30a508b3b30e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/567c6ec8-ab1c-4391-a179-0964a672ca96_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/1c73e968-5846-436b-b796-57641c7e1cfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/f002c7ab-03d7-4469-bd80-f7a50f480979_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKT/2025-11-10/image/4c01683b-bdd0-4672-b434-e3bc571cb634_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 03/24-16K', 'remarks': 'SPARE KEY, VOSA STATES 24K, Metallic - Reflex silver, Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ae4958bd-3669-49e3-9bb1-a58eb86f3bc8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b871cfc-e9c5-5250-9bf9-104a3b34cae0 with identifier: 116963745
2025-11-27 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b871cfc-e9c5-5250-9bf9-104a3b34cae0 with scrape type 2
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b871cfc-e9c5-5250-9bf9-104a3b34cae0 with scrape type 2
2025-11-27 19:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5b871cfc-e9c5-5250-9bf9-104a3b34cae0, identifier: 116963745
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116833742, 'registration': 'BJ72XGU', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 30047, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-01', 'fuel': 'Electric', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-20k,', 'remarks': 'SPARE KEY, VOSA STATES 29K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8907362-8d3e-4454-951f-e3fb548100a4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116833742, 'registration': 'BJ72XGU', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 30047, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-01', 'fuel': 'Electric', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-20k,', 'remarks': 'SPARE KEY, VOSA STATES 29K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8907362-8d3e-4454-951f-e3fb548100a4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with identifier: 116833742
2025-11-27 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with scrape type 1
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Found listing with ID: 117235504
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117235504%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Scrape type for 117235504: 1
2025-11-27 19:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116280997?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5b871cfc-e9c5-5250-9bf9-104a3b34cae0 with identifier: 116963745
2025-11-27 19:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5b871cfc-e9c5-5250-9bf9-104a3b34cae0 with identifier: 116963745
2025-11-27 19:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5b871cfc-e9c5-5250-9bf9-104a3b34cae0 with identifier: 116963745 to the API
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116963745?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5b871cfc-e9c5-5250-9bf9-104a3b34cae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22UKT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116963745',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 26943,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116963745%27 HTTP/1.1" 200 None
2025-11-27 19:04:09 [astonbarclay.gb] INFO: Saving data for 116963745: {'auction_closing_time': 1764842400.0, 'created_time': 1763147206.919507, 'last_price_update_time': 1764270249.888617}
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963745') HTTP/1.1" 204 0
2025-11-27 19:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c35f4d0>
2025-11-27 19:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/c64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252Ff8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252Fde20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/de20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252Fd201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/d201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252Ff334651e-109a-44b7-a165-f883c8427a10_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fbc18730a-d719-4155-a068-574c99169992_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fea413806-589c-4823-b360-97b861c76aed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab9ed0>
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:04:10 [astonbarclay.gb] INFO: Found listing with ID: 116666877
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116666877%27 HTTP/1.1" 200 None
2025-11-27 19:04:10 [astonbarclay.gb] INFO: Scrape type for 116666877: 1
2025-11-27 19:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e95af90>
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fddb910>
2025-11-27 19:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc2710>
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd8750>
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd9550>
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e958210>
2025-11-27 19:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fd3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/d3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F059497c0-41eb-4555-a73d-21c401943806_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/059497c0-41eb-4555-a73d-21c401943806_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252F86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fa012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116280997, 'registration': 'GU72VHK', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 27494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-08', 'fuel': 'Electric', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHK/2025-10-31/image/f6626e5f-c699-4ddd-b2b9-e63fc0f140dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/8f6a41c7-9d18-46d3-9e04-a43669f27a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/06355831-9969-47c1-897e-e3cda2ab58d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e261c408-f652-4d19-9028-0e4618d349e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/1445fbad-4a69-4e2f-a758-24bb1972af68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e5036134-abb4-460c-9609-3fce108f0de8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/5b542d13-ff38-4999-ae7f-ac6246b48699_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/6ad931e5-d88d-4a0d-bd30-66ef1edc1783_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-8K, 11/24-18K,', 'remarks': 'SPARE KEY, vosa states 25k, *Metallic - Mojave silver, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0c73a7d3-ec64-4824-ba22-8df802d3773b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116280997, 'registration': 'GU72VHK', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 27494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-08', 'fuel': 'Electric', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHK/2025-10-31/image/f6626e5f-c699-4ddd-b2b9-e63fc0f140dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/8f6a41c7-9d18-46d3-9e04-a43669f27a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/06355831-9969-47c1-897e-e3cda2ab58d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e261c408-f652-4d19-9028-0e4618d349e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/1445fbad-4a69-4e2f-a758-24bb1972af68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e5036134-abb4-460c-9609-3fce108f0de8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/5b542d13-ff38-4999-ae7f-ac6246b48699_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/6ad931e5-d88d-4a0d-bd30-66ef1edc1783_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-8K, 11/24-18K,', 'remarks': 'SPARE KEY, vosa states 25k, *Metallic - Mojave silver, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0c73a7d3-ec64-4824-ba22-8df802d3773b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81bcc2e-4ebc-58e0-ad41-cc52388682db with identifier: 116280997
2025-11-27 19:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81bcc2e-4ebc-58e0-ad41-cc52388682db with scrape type 2
2025-11-27 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b81bcc2e-4ebc-58e0-ad41-cc52388682db with scrape type 2
2025-11-27 19:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b81bcc2e-4ebc-58e0-ad41-cc52388682db, identifier: 116280997
2025-11-27 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:04:12 [astonbarclay.gb] INFO: Found listing with ID: 117256307
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256307%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [astonbarclay.gb] INFO: Scrape type for 117256307: 1
2025-11-27 19:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024845?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b81bcc2e-4ebc-58e0-ad41-cc52388682db with identifier: 116280997
2025-11-27 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b81bcc2e-4ebc-58e0-ad41-cc52388682db with identifier: 116280997
2025-11-27 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 27494, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116280997', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vhk', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b81bcc2e-4ebc-58e0-ad41-cc52388682db', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 44247} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b81bcc2e-4ebc-58e0-ad41-cc52388682db',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72vhk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116280997',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 27494,
     'odometer_in_km': 44247,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-08',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b81bcc2e-4ebc-58e0-ad41-cc52388682db spider: astonbarclay.gb
2025-11-27 19:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b81bcc2e-4ebc-58e0-ad41-cc52388682db due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 27494, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116280997', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vhk', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b81bcc2e-4ebc-58e0-ad41-cc52388682db', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 44247} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b81bcc2e-4ebc-58e0-ad41-cc52388682db',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72vhk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116280997',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 27494,
     'odometer_in_km': 44247,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-08',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'b81bcc2e-4ebc-58e0-ad41-cc52388682db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72VHK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116280997',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 27494,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-08',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116280997%27 HTTP/1.1" 200 None
2025-11-27 19:04:12 [astonbarclay.gb] INFO: Saving data for 116280997: {'auction_closing_time': 1764842400.0, 'created_time': 1763147056.359104, 'last_price_update_time': 1764270252.656254}
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116280997') HTTP/1.1" 204 0
2025-11-27 19:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e913150>
2025-11-27 19:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb79b10>
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252Fc64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/c64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252Fc43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252Ffb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fd093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc2050>
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fbbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd2c750>
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252Fcfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9621d0>
2025-11-27 19:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:14 [astonbarclay.gb] INFO: Found listing with ID: 117099210
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099210%27 HTTP/1.1" 200 None
2025-11-27 19:04:14 [astonbarclay.gb] INFO: Scrape type for 117099210: 1
2025-11-27 19:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc2910>
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_14.jpg HTTP/1.1" 201 0
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg?w=600 saved to cache
2025-11-27 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb92a10>
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb14b50>
2025-11-27 19:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252Fae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd1490>
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:04:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117424159, 'registration': 'RO71FNT', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'ID.3 HATCHBACK', 'derivative': '107KW Life Pro 58kWh 5dr Auto', 'mileage': 51570, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-18', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/23-21k, 01/25-41k, 05/25-45k,', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/19f30317-6a39-4975-bb43-912188bc3322.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117424159, 'registration': 'RO71FNT', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'ID.3 HATCHBACK', 'derivative': '107KW Life Pro 58kWh 5dr Auto', 'mileage': 51570, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-18', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/23-21k, 01/25-41k, 05/25-45k,', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/19f30317-6a39-4975-bb43-912188bc3322.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8cee250-a846-561e-85a8-e4b5ac927c42 with identifier: 117424159
2025-11-27 19:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cee250-a846-561e-85a8-e4b5ac927c42 with scrape type 1
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252Fc5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/c5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fc8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe5c910>
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:04:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024845, 'registration': 'ML70LNO', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 63954, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-11-06', 'fuel': 'Petrol', 'motExpiry': '2026-11-05', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML70LNO/2025-11-13/image/202d3c34-13f6-445d-b5e0-1ae0637cfc2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/d1096d55-7072-4824-9d1a-81567a2b7e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/b4cc94d1-b3f7-4a05-9363-5ac8c1609848_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/1a0b18f0-7d8a-467a-9cf6-381c0c20a382_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/d58ba4ef-23d2-4ad6-b98b-56fabfe5de34_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/5e1d1cf9-9928-499b-a93e-1852ed519324_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/b2fbd1cd-f102-4f48-8328-dacd27106e8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/c493b4e1-13cc-4081-a181-27b6c55476a6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/23-31K,', 'remarks': 'SPARE KEY, VOSA STATES 39K 56K 63K, Metallic - Deep black pearl, Art velours cloth - Soul + front sports comfort seats', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/408f3449-9aa5-42b4-b9dd-7e2eeff41636.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024845, 'registration': 'ML70LNO', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Style 5dr', 'mileage': 63954, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-11-06', 'fuel': 'Petrol', 'motExpiry': '2026-11-05', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML70LNO/2025-11-13/image/202d3c34-13f6-445d-b5e0-1ae0637cfc2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/d1096d55-7072-4824-9d1a-81567a2b7e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/b4cc94d1-b3f7-4a05-9363-5ac8c1609848_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/1a0b18f0-7d8a-467a-9cf6-381c0c20a382_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/d58ba4ef-23d2-4ad6-b98b-56fabfe5de34_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/5e1d1cf9-9928-499b-a93e-1852ed519324_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/b2fbd1cd-f102-4f48-8328-dacd27106e8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML70LNO/2025-11-13/image/c493b4e1-13cc-4081-a181-27b6c55476a6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/23-31K,', 'remarks': 'SPARE KEY, VOSA STATES 39K 56K 63K, Metallic - Deep black pearl, Art velours cloth - Soul + front sports comfort seats', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/408f3449-9aa5-42b4-b9dd-7e2eeff41636.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4026a5ec-3a40-55dd-8aef-79fe081374db with identifier: 117024845
2025-11-27 19:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4026a5ec-3a40-55dd-8aef-79fe081374db with scrape type 2
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4026a5ec-3a40-55dd-8aef-79fe081374db with scrape type 2
2025-11-27 19:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4026a5ec-3a40-55dd-8aef-79fe081374db, identifier: 117024845
2025-11-27 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/d201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:04:15 [astonbarclay.gb] INFO: Found listing with ID: 117101358
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101358%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [astonbarclay.gb] INFO: Scrape type for 117101358: 1
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4026a5ec-3a40-55dd-8aef-79fe081374db with identifier: 117024845
2025-11-27 19:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4026a5ec-3a40-55dd-8aef-79fe081374db with identifier: 117024845
2025-11-27 19:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4026a5ec-3a40-55dd-8aef-79fe081374db with identifier: 117024845 to the API
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024845?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4026a5ec-3a40-55dd-8aef-79fe081374db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ML70LNO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024845',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 63954,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-06',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI Style 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Style 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024845%27 HTTP/1.1" 200 None
2025-11-27 19:04:16 [astonbarclay.gb] INFO: Saving data for 117024845: {'auction_closing_time': 1764842400.0, 'created_time': 1763147030.691222, 'last_price_update_time': 1764270256.249898}
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024845') HTTP/1.1" 204 0
2025-11-27 19:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaa6b50>
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3dc50>
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd43210>
2025-11-27 19:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252F8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec40b90>
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/de20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252Fa87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/a87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252F8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fa5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea5af10>
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea6b310>
2025-11-27 19:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/059497c0-41eb-4555-a73d-21c401943806_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:18 [astonbarclay.gb] INFO: Found listing with ID: 117277530
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117277530%27 HTTP/1.1" 200 None
2025-11-27 19:04:18 [astonbarclay.gb] INFO: Scrape type for 117277530: 1
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea13a10>
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fea413806-589c-4823-b360-97b861c76aed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fef42d0>
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fbc18730a-d719-4155-a068-574c99169992_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252Faa381a43-b729-4fe1-926d-786316054656_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fbc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eacb850>
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252Fd201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/d201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e91b250>
2025-11-27 19:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252Ff334651e-109a-44b7-a165-f883c8427a10_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:04:19 [astonbarclay.gb] INFO: Found listing with ID: 117364404
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364404%27 HTTP/1.1" 200 None
2025-11-27 19:04:19 [astonbarclay.gb] INFO: Scrape type for 117364404: 1
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea07f10>
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbe090>
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252F86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea30dd0>
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fa012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea2a7d0>
2025-11-27 19:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252Fde20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/de20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/c5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252Fb3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Febe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fedbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116183620?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec44250>
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece4850>
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F059497c0-41eb-4555-a73d-21c401943806_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/059497c0-41eb-4555-a73d-21c401943806_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117235504, 'registration': 'MC23EFM', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line X Edition 5dr CVT', 'mileage': 46488, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-11', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MC23EFM/2025-11-18/image/4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/f7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/d3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/a00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24-14k, 08/24-30k, 04/25-44k,', 'remarks': 'spare key', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 24, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89114169-e83e-4a31-b971-c488d241b2e0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117235504, 'registration': 'MC23EFM', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line X Edition 5dr CVT', 'mileage': 46488, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-07-11', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MC23EFM/2025-11-18/image/4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/f7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/d3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/a00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24-14k, 08/24-30k, 04/25-44k,', 'remarks': 'spare key', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 24, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89114169-e83e-4a31-b971-c488d241b2e0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82d27e7-821c-59cd-951a-ea49b5e76fce with identifier: 117235504
2025-11-27 19:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82d27e7-821c-59cd-951a-ea49b5e76fce with scrape type 1
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:20 [astonbarclay.gb] INFO: Found listing with ID: 117402830
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402830%27 HTTP/1.1" 200 None
2025-11-27 19:04:20 [astonbarclay.gb] INFO: Scrape type for 117402830: 1
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e830b50>
2025-11-27 19:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbde10>
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb56f10>
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fd093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc15d0>
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:21 [astonbarclay.gb] INFO: Found listing with ID: 117329064
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117329064%27 HTTP/1.1" 200 None
2025-11-27 19:04:21 [astonbarclay.gb] INFO: Scrape type for 117329064: 1
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252Fc3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fda1ed0>
2025-11-27 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252Fc5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/c5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec5d190>
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece3c90>
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe50d10>
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fc8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116183620, 'registration': 'GU72YKO', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 23580, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-22', 'fuel': 'Electric', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YKO/2025-10-09/image/0fbd766b-3873-42fc-aac6-4decc05b3da9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/42455cb4-3596-45b1-8114-260737317b3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/3bd1fe80-07c5-41db-94fb-67af90359946_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/833557f8-fb44-486f-bae6-90d3cdc1ac96_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/bf1b9c05-aa66-4643-9399-170dae035a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/c051b69f-f485-49c7-a640-fd74daa29e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/1f1b4ba6-4fa7-479c-a3e4-f28795ea4a05_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/fdb9a493-21c0-47c6-a25c-cc9b13090a79_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/23-8K, 09/24-16K, 09/25-22K,', 'remarks': 'vosa states 22k, SPARE KEY, *Metallic - Obsidian black, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/603405fd-b4a1-425c-89af-b3332f283e74.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116183620, 'registration': 'GU72YKO', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 23580, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-22', 'fuel': 'Electric', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YKO/2025-10-09/image/0fbd766b-3873-42fc-aac6-4decc05b3da9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/42455cb4-3596-45b1-8114-260737317b3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/3bd1fe80-07c5-41db-94fb-67af90359946_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/833557f8-fb44-486f-bae6-90d3cdc1ac96_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/bf1b9c05-aa66-4643-9399-170dae035a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/c051b69f-f485-49c7-a640-fd74daa29e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/1f1b4ba6-4fa7-479c-a3e4-f28795ea4a05_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/fdb9a493-21c0-47c6-a25c-cc9b13090a79_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/23-8K, 09/24-16K, 09/25-22K,', 'remarks': 'vosa states 22k, SPARE KEY, *Metallic - Obsidian black, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/603405fd-b4a1-425c-89af-b3332f283e74.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c543584-df90-5d7e-9e5b-05dcfea64fca with identifier: 116183620
2025-11-27 19:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c543584-df90-5d7e-9e5b-05dcfea64fca with scrape type 2
2025-11-27 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c543584-df90-5d7e-9e5b-05dcfea64fca with scrape type 2
2025-11-27 19:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1c543584-df90-5d7e-9e5b-05dcfea64fca, identifier: 116183620
2025-11-27 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252Ff7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/f7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1c543584-df90-5d7e-9e5b-05dcfea64fca with identifier: 116183620
2025-11-27 19:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1c543584-df90-5d7e-9e5b-05dcfea64fca with identifier: 116183620
2025-11-27 19:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 23580, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116183620', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72yko', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '1c543584-df90-5d7e-9e5b-05dcfea64fca', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 37948} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '1c543584-df90-5d7e-9e5b-05dcfea64fca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72yko',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116183620',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 23580,
     'odometer_in_km': 37948,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-22',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 1c543584-df90-5d7e-9e5b-05dcfea64fca spider: astonbarclay.gb
2025-11-27 19:04:23 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1c543584-df90-5d7e-9e5b-05dcfea64fca due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 23580, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-22', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116183620', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72yko', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '1c543584-df90-5d7e-9e5b-05dcfea64fca', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 37948} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '1c543584-df90-5d7e-9e5b-05dcfea64fca',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72yko',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116183620',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 23580,
     'odometer_in_km': 37948,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-22',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '1c543584-df90-5d7e-9e5b-05dcfea64fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72YKO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116183620',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 23580,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116183620%27 HTTP/1.1" 200 None
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Saving data for 116183620: {'auction_closing_time': 1764842400.0, 'created_time': 1763147064.726393, 'last_price_update_time': 1764270263.410372}
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116183620') HTTP/1.1" 204 0
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd92910>
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117256307, 'registration': 'OV71KXJ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'ENYAQ IV ESTATE', 'derivative': '132kW 60 ecoSuite 62kWh 5dr Auto', 'mileage': 96532, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-11-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 10/25-95k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db4c4783-84e2-4df0-b41f-dcc8808d4af0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117256307, 'registration': 'OV71KXJ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'ENYAQ IV ESTATE', 'derivative': '132kW 60 ecoSuite 62kWh 5dr Auto', 'mileage': 96532, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-11-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 10/25-95k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db4c4783-84e2-4df0-b41f-dcc8808d4af0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 696f7c52-0072-5b70-95f2-a5ab6ddda589 with identifier: 117256307
2025-11-27 19:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 696f7c52-0072-5b70-95f2-a5ab6ddda589 with scrape type 1
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116666877, 'registration': 'WK25HGE', 'account': 'KIN032', 'make': 'DACIA', 'model': 'SANDERO HATCHBACK', 'derivative': '1.0 Tce Journey 5dr', 'mileage': 16485, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-03-04', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WK25HGE/2025-11-20/image/dadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/a8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/b41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/f6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/c6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/cac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58b4fa1c-894a-4595-9a5a-052e6cad3baf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116666877, 'registration': 'WK25HGE', 'account': 'KIN032', 'make': 'DACIA', 'model': 'SANDERO HATCHBACK', 'derivative': '1.0 Tce Journey 5dr', 'mileage': 16485, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2025-03-04', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WK25HGE/2025-11-20/image/dadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/a8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/b41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/f6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/c6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/cac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/58b4fa1c-894a-4595-9a5a-052e6cad3baf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0726d4c-3adb-51e1-808f-9bb0a77a18dd with identifier: 116666877
2025-11-27 19:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd with scrape type 1
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fdadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/dadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Found listing with ID: 117364152
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364152%27 HTTP/1.1" 200 None
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Scrape type for 117364152: 1
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252Fc0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd4e90>
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fa5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117264969, 'registration': 'OY71KYZ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI SE Technology 5dr', 'mileage': 43944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-09-13', 'fuel': 'Diesel', 'motExpiry': '2026-10-02', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/f06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/ad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/fd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/a0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/23-17k, 04/24-29k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b7daa442-d4c2-4e74-ac4e-be3dad6efe55.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117264969, 'registration': 'OY71KYZ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI SE Technology 5dr', 'mileage': 43944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-09-13', 'fuel': 'Diesel', 'motExpiry': '2026-10-02', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/f06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/ad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/fd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/a0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg?w=600', 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/23-17k, 04/24-29k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b7daa442-d4c2-4e74-ac4e-be3dad6efe55.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2afae0b-e1d1-5d56-9607-b6f19bb0877d with identifier: 117264969
2025-11-27 19:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d with scrape type 1
2025-11-27 19:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue)
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252Fd3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/d3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252Fb1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252F8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8febe790>
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea48f90>
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8febc750>
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252F8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116772841?view=catalogue)
2025-11-27 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117495085
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495085%27 HTTP/1.1" 200 None
2025-11-27 19:04:24 [astonbarclay.gb] INFO: Scrape type for 117495085: 0
2025-11-27 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117495107
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495107%27 HTTP/1.1" 200 None
2025-11-27 19:04:24 [astonbarclay.gb] INFO: Scrape type for 117495107: 0
2025-11-27 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117495054
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495054%27 HTTP/1.1" 200 None
2025-11-27 19:04:24 [astonbarclay.gb] INFO: Scrape type for 117495054: 0
2025-11-27 19:04:24 [astonbarclay.gb] INFO: Found listing with ID: 117495072
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495072%27 HTTP/1.1" 200 None
2025-11-27 19:04:25 [astonbarclay.gb] INFO: Scrape type for 117495072: 0
2025-11-27 19:04:25 [astonbarclay.gb] INFO: Found listing with ID: 116941457
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116941457%27 HTTP/1.1" 200 None
2025-11-27 19:04:25 [astonbarclay.gb] INFO: Scrape type for 116941457: 2
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Ff06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/f06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd73c10>
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e94efd0>
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252Faa381a43-b729-4fe1-926d-786316054656_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea9ad90>
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252F7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/a87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fa8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/a8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd58f10>
2025-11-27 19:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e951410>
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Fbc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117101358, 'registration': 'YP72WBE', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line Edition 5dr CVT', 'mileage': 39428, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP72WBE/2025-11-19/image/795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/d25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/24-18k, 09/25-34k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/15a278ea-499d-4e2a-8340-efa9168efe15.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117101358, 'registration': 'YP72WBE', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line Edition 5dr CVT', 'mileage': 39428, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP72WBE/2025-11-19/image/795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/d25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 05/24-18k, 09/25-34k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/15a278ea-499d-4e2a-8340-efa9168efe15.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72b25f4-8b49-558e-bf65-eda272383035 with identifier: 117101358
2025-11-27 19:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72b25f4-8b49-558e-bf65-eda272383035 with scrape type 1
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117099210, 'registration': 'ND21ECZ', 'account': 'KIN032', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '150kW 4+ 64kWh 5dr Auto', 'mileage': 38504, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-06-10', 'fuel': 'Electric', 'motExpiry': '2026-06-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/22 9K 07/23 18K 08/24 26K 05/25 34K', 'remarks': 'SPARE KEY VOSA STATES 26K 34K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14844f5a-dbaf-4c12-83fb-f8746491f125.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117099210, 'registration': 'ND21ECZ', 'account': 'KIN032', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '150kW 4+ 64kWh 5dr Auto', 'mileage': 38504, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-06-10', 'fuel': 'Electric', 'motExpiry': '2026-06-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/22 9K 07/23 18K 08/24 26K 05/25 34K', 'remarks': 'SPARE KEY VOSA STATES 26K 34K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14844f5a-dbaf-4c12-83fb-f8746491f125.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37daea7-64c2-52b2-a586-c4295913a1b6 with identifier: 117099210
2025-11-27 19:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37daea7-64c2-52b2-a586-c4295913a1b6 with scrape type 1
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:26 [astonbarclay.gb] INFO: Found listing with ID: 117554606
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554606%27 HTTP/1.1" 200 None
2025-11-27 19:04:26 [astonbarclay.gb] INFO: Scrape type for 117554606: 1
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Fad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/ad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea9ae50>
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fefda10>
2025-11-27 19:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBJ72XGU%252F2025-10-31%252Fimage%252Fedbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366
2025-11-27 19:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 768dc5ad-bed0-59b4-9296-cfd1b5a15366, skipping ID generation
2025-11-27 19:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with scrape type 1
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 768dc5ad-bed0-59b4-9296-cfd1b5a15366 from tracking dictionaries
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366 sending to next pipeline
2025-11-27 19:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 768dc5ad-bed0-59b4-9296-cfd1b5a15366, identifier: 116833742
2025-11-27 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/dadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/f7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fb41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/b41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with identifier: 116833742
2025-11-27 19:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with identifier: 116833742
2025-11-27 19:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30047, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116833742', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'bj72xgu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '768dc5ad-bed0-59b4-9296-cfd1b5a15366', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31233}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30759}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29260}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48980}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 48355} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '768dc5ad-bed0-59b4-9296-cfd1b5a15366',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bj72xgu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116833742',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 30047,
     'odometer_in_km': 48355,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30276,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31233,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30759,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29260,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49531,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39478,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49645,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48980,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-01',
     'sanitized_make': 'cupra',
     'seller_name': 'kinto',
     'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v2 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 spider: astonbarclay.gb
2025-11-27 19:04:27 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30047, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-01', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116833742', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'bj72xgu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '768dc5ad-bed0-59b4-9296-cfd1b5a15366', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31233}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30759}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29260}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 49645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48980}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 48355} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '768dc5ad-bed0-59b4-9296-cfd1b5a15366',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bj72xgu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116833742',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 30047,
     'odometer_in_km': 48355,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30276,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31233,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30759,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29260,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49531,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39478,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49645,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48980,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-01',
     'sanitized_make': 'cupra',
     'seller_name': 'kinto',
     'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v2 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '768dc5ad-bed0-59b4-9296-cfd1b5a15366',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BJ72XGU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116833742',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 30047,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30276,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31233,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30759,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29260,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49531,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39478,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49645,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768dc5ad-bed0-59b4-9296-cfd1b5a15366/768dc5ad-bed0-59b4-9296-cfd1b5a15366_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48980,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-01',
 'seller_name': 'Kinto',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V2 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V2 58kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833742%27 HTTP/1.1" 200 None
2025-11-27 19:04:27 [astonbarclay.gb] INFO: Saving data for 116833742: {'created_time': 1764270267.810607, 'last_price_update_time': 1764270267.810615, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116833742') HTTP/1.1" 204 0
2025-11-27 19:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea35550>
2025-11-27 19:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e90f710>
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb5aed0>
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DGF%252F2025-11-10%252Fimage%252Febe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00f77c2c-04c7-556e-93e9-f161290a6916
2025-11-27 19:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00f77c2c-04c7-556e-93e9-f161290a6916, skipping ID generation
2025-11-27 19:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f77c2c-04c7-556e-93e9-f161290a6916 with scrape type 1
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 00f77c2c-04c7-556e-93e9-f161290a6916 from tracking dictionaries
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00f77c2c-04c7-556e-93e9-f161290a6916 sending to next pipeline
2025-11-27 19:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 00f77c2c-04c7-556e-93e9-f161290a6916, identifier: 116772841
2025-11-27 19:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:04:28 [astonbarclay.gb] INFO: Found listing with ID: 117517620
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517620%27 HTTP/1.1" 200 None
2025-11-27 19:04:28 [astonbarclay.gb] INFO: Scrape type for 117517620: 0
2025-11-27 19:04:28 [astonbarclay.gb] INFO: Found listing with ID: 117517693
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517693%27 HTTP/1.1" 200 None
2025-11-27 19:04:28 [astonbarclay.gb] INFO: Scrape type for 117517693: 0
2025-11-27 19:04:28 [astonbarclay.gb] INFO: Found listing with ID: 117242484
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242484%27 HTTP/1.1" 200 None
2025-11-27 19:04:28 [astonbarclay.gb] INFO: Scrape type for 117242484: 1
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 00f77c2c-04c7-556e-93e9-f161290a6916 with identifier: 116772841
2025-11-27 19:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 00f77c2c-04c7-556e-93e9-f161290a6916 with identifier: 116772841
2025-11-27 19:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 24386, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116772841', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gy72dgf', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '00f77c2c-04c7-556e-93e9-f161290a6916', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35844}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 70718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 69740}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 73361}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 39245} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '00f77c2c-04c7-556e-93e9-f161290a6916',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gy72dgf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116772841',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 24386,
     'odometer_in_km': 39245,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35844,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35278,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33860,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32960,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56177,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70718,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73361,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-25',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 00f77c2c-04c7-556e-93e9-f161290a6916 spider: astonbarclay.gb
2025-11-27 19:04:29 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 00f77c2c-04c7-556e-93e9-f161290a6916 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 24386, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116772841', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gy72dgf', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '00f77c2c-04c7-556e-93e9-f161290a6916', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35844}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 70718}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 69740}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 73361}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 39245} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '00f77c2c-04c7-556e-93e9-f161290a6916',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gy72dgf',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116772841',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 24386,
     'odometer_in_km': 39245,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35844,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35278,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33860,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32960,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56177,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70718,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73361,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-25',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '00f77c2c-04c7-556e-93e9-f161290a6916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GY72DGF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116772841',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 24386,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35844,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8341d8af-2ca8-417a-9fa4-606f3fb8882d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35278,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc18730a-d719-4155-a068-574c99169992_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33860,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/86dd6b55-ab5c-4b04-8e9d-4a9cfef1804f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32960,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/d093507d-9fc0-4787-8738-605d3c8611a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56177,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/c8462be0-4245-48cd-ad76-640d1f8556bf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70718,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/8cabf431-6f44-4727-941b-2e9302bf87a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69740,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/bc66003d-79c6-4ff5-a3fe-a00f971b3a32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00f77c2c-04c7-556e-93e9-f161290a6916/00f77c2c-04c7-556e-93e9-f161290a6916_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73361,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DGF/2025-11-10/image/ebe5cc9a-7999-4b89-9e93-f9f9f5e48d3d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116772841%27 HTTP/1.1" 200 None
2025-11-27 19:04:29 [astonbarclay.gb] INFO: Saving data for 116772841: {'created_time': 1764270269.134449, 'last_price_update_time': 1764270269.13446, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116772841') HTTP/1.1" 204 0
2025-11-27 19:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece0c10>
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1c790>
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252Fa87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/a87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe5ff10>
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252Fb3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252Fa00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/a00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252Fedb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252F0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaba1d0>
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252Fc3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e995e90>
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117277530, 'registration': 'KY20FRF', 'account': 'KIN032', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi PHEV 3 5dr DCT', 'mileage': 70796, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KY20FRF/2025-11-25/image/589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/bde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/a620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/d1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/21-10k, 11/21-22k, 08/22-33k, 05/23-44k, 02/24-55k, 02/25-63k,', 'remarks': 'SPARE KEY, VOSA STATES 40K 55K 63K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2bbada4-717c-410b-885d-bfd05cf8ece3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117277530, 'registration': 'KY20FRF', 'account': 'KIN032', 'make': 'KIA', 'model': 'NIRO ESTATE', 'derivative': '1.6 GDi PHEV 3 5dr DCT', 'mileage': 70796, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1580, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KY20FRF/2025-11-25/image/589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/bde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/a620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/d1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 02/21-10k, 11/21-22k, 08/22-33k, 05/23-44k, 02/24-55k, 02/25-63k,', 'remarks': 'SPARE KEY, VOSA STATES 40K 55K 63K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a2bbada4-717c-410b-885d-bfd05cf8ece3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd4bee19-35a9-52eb-a2fc-cf1767839301 with identifier: 117277530
2025-11-27 19:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4bee19-35a9-52eb-a2fc-cf1767839301 with scrape type 1
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117424159?view=catalogue)
2025-11-27 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/f06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/d3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:04:30 [astonbarclay.gb] INFO: Found listing with ID: 117209040
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209040%27 HTTP/1.1" 200 None
2025-11-27 19:04:30 [astonbarclay.gb] INFO: Scrape type for 117209040: 1
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Ffd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/fd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac1450>
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fdadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/dadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e99eb50>
2025-11-27 19:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e99c410>
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252Ff7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/f7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/a8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252Fd56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Ff6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/f6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252Fcaf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252Fbde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/bde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec22190>
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e994490>
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252Fc0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea445d0>
2025-11-27 19:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/ad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:04:32 [astonbarclay.gb] INFO: Found listing with ID: 117550564
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550564%27 HTTP/1.1" 200 None
2025-11-27 19:04:32 [astonbarclay.gb] INFO: Scrape type for 117550564: 1
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd0d610>
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252F8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e90a410>
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252Fb1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fc6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/c6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252Ff30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e928bd0>
2025-11-27 19:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO71FNT%252F2025-11-25%252Fimage%252F0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8cee250-a846-561e-85a8-e4b5ac927c42
2025-11-27 19:04:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8cee250-a846-561e-85a8-e4b5ac927c42, skipping ID generation
2025-11-27 19:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cee250-a846-561e-85a8-e4b5ac927c42 with scrape type 1
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8cee250-a846-561e-85a8-e4b5ac927c42 from tracking dictionaries
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8cee250-a846-561e-85a8-e4b5ac927c42 sending to next pipeline
2025-11-27 19:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8cee250-a846-561e-85a8-e4b5ac927c42, identifier: 117424159
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e8516d0>
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Ff06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/f06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9e795c10>
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252Fd3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/d3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:04:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117329064, 'registration': 'DV22UNN', 'account': 'KIN032', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy EV 51kWh 5dr Auto', 'mileage': 9836, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-31', 'fuel': 'Electric', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/25-7k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2bb5b17b-66af-4adb-98be-d73c68720453.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117329064, 'registration': 'DV22UNN', 'account': 'KIN032', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy EV 51kWh 5dr Auto', 'mileage': 9836, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-31', 'fuel': 'Electric', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/25-7k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2bb5b17b-66af-4adb-98be-d73c68720453.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with identifier: 117329064
2025-11-27 19:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with scrape type 1
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/b41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:33 [astonbarclay.gb] INFO: Found listing with ID: 117550544
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550544%27 HTTP/1.1" 200 None
2025-11-27 19:04:33 [astonbarclay.gb] INFO: Scrape type for 117550544: 1
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Fa0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/a0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8cee250-a846-561e-85a8-e4b5ac927c42 with identifier: 117424159
2025-11-27 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8cee250-a846-561e-85a8-e4b5ac927c42 with identifier: 117424159
2025-11-27 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volkswagen id.3 hatchback 107kw life pro 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51570, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424159', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '107kw life pro 58kwh 5dr auto', 'license_plate': 'ro71fnt', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f8cee250-a846-561e-85a8-e4b5ac927c42', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29263}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27695}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52640}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46999}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54043}], 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'volkswagen id.3 hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 82993} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'f8cee250-a846-561e-85a8-e4b5ac927c42',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ro71fnt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424159',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.3 hatchback',
     'model': 'id.3 hatchback',
     'odometer': 51570,
     'odometer_in_km': 82993,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29263,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27967,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26515,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27695,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52640,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46999,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46515,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54043,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-18',
     'sanitized_make': 'volkswagen',
     'seller_name': 'kinto',
     'title': 'volkswagen id.3 hatchback 107kw life pro 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '107kw life pro 58kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-11-27 19:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: f8cee250-a846-561e-85a8-e4b5ac927c42 spider: astonbarclay.gb
2025-11-27 19:04:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f8cee250-a846-561e-85a8-e4b5ac927c42 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volkswagen id.3 hatchback 107kw life pro 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 51570, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424159', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '107kw life pro 58kwh 5dr auto', 'license_plate': 'ro71fnt', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'f8cee250-a846-561e-85a8-e4b5ac927c42', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29263}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 27695}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52640}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46999}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46515}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 54043}], 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'volkswagen id.3 hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 82993} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'f8cee250-a846-561e-85a8-e4b5ac927c42',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ro71fnt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424159',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.3 hatchback',
     'model': 'id.3 hatchback',
     'odometer': 51570,
     'odometer_in_km': 82993,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29263,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27967,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26515,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27695,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52640,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46999,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46515,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54043,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-18',
     'sanitized_make': 'volkswagen',
     'seller_name': 'kinto',
     'title': 'volkswagen id.3 hatchback 107kw life pro 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '107kw life pro 58kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'f8cee250-a846-561e-85a8-e4b5ac927c42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RO71FNT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117424159',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'ID.3 HATCHBACK',
 'odometer': 51570,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29263,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/25b78b96-2de2-4cf2-a00e-167ebbd20b7e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27967,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/04bf90dd-0a53-4b6c-8551-278ab10fb19b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26515,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/7d55559d-c851-4975-8cf7-90ed426d265a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27695,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/55e12591-8f10-4eb0-b302-a68719be0d6f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52640,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/26611f62-8f82-43c8-9f92-5b77396261c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46999,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c3ebd804-60dd-4f5e-8101-873e1ccfdba2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46515,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/c0484d67-ec7c-4db9-84c3-e73832642e6b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cee250-a846-561e-85a8-e4b5ac927c42/f8cee250-a846-561e-85a8-e4b5ac927c42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54043,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO71FNT/2025-11-25/image/0836bdc9-1477-4502-a6d5-7f29aef2da11_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN ID.3 HATCHBACK 107KW Life Pro 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '107KW Life Pro 58kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424159%27 HTTP/1.1" 200 None
2025-11-27 19:04:34 [astonbarclay.gb] INFO: Saving data for 117424159: {'created_time': 1764270274.11333, 'last_price_update_time': 1764270274.113339, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117424159') HTTP/1.1" 204 0
2025-11-27 19:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c71ea10>
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0e6c90>
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec18890>
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fa8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/a8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fcac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/cac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252Fd25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/d25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252Fa620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/a620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98d890>
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Fad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/ad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecdc950>
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:04:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117364152, 'registration': 'FX73PTZ', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQB ESTATE', 'derivative': 'EQB 350 4M 215kW AMG Line Prem Plus 66.5kWh 5dr At', 'mileage': 17639, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-08', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24 7K 11/25 17K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4fb303d6-a1c5-47e3-963c-88adfc927210.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117364152, 'registration': 'FX73PTZ', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQB ESTATE', 'derivative': 'EQB 350 4M 215kW AMG Line Prem Plus 66.5kWh 5dr At', 'mileage': 17639, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-09-08', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24 7K 11/25 17K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4fb303d6-a1c5-47e3-963c-88adfc927210.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd9b4b06-b257-5599-bc08-83bd16e26e40 with identifier: 117364152
2025-11-27 19:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9b4b06-b257-5599-bc08-83bd16e26e40 with scrape type 1
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/fd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:04:35 [astonbarclay.gb] INFO: Found listing with ID: 117554544
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554544%27 HTTP/1.1" 200 None
2025-11-27 19:04:35 [astonbarclay.gb] INFO: Scrape type for 117554544: 1
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554606?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec8a910>
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea63bd0>
2025-11-27 19:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec12350>
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:04:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117402830, 'registration': 'LJ70YZS', 'account': 'KIN032', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 74786, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-09-23', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/cdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/eac08488-fa88-4546-b35d-4682461096f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/88de37ba-8063-4916-97d2-830491c22251_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/bcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/25-74k,', 'remarks': 'SPARE KEY, vosa states 48k, 63k, 74k,', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ab2ab505-1148-47a8-b57e-affe0ef66494.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117402830, 'registration': 'LJ70YZS', 'account': 'KIN032', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 74786, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-09-23', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/cdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/eac08488-fa88-4546-b35d-4682461096f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/88de37ba-8063-4916-97d2-830491c22251_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/bcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/25-74k,', 'remarks': 'SPARE KEY, vosa states 48k, 63k, 74k,', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ab2ab505-1148-47a8-b57e-affe0ef66494.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b88ec5df-4962-5363-9255-f5e11fadffe1 with identifier: 117402830
2025-11-27 19:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b88ec5df-4962-5363-9255-f5e11fadffe1 with scrape type 1
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252Fcdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/cdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117364404, 'registration': 'VO71HFZ', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'CORSA ELECTRIC HATCHBACK', 'derivative': '100kW SE Nav Premium 50kWh 5dr Auto [7.4kWCh]', 'mileage': 45799, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-16', 'fuel': 'Electric', 'motExpiry': '2026-12-15', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22-8k, 07/23-17k, 06/24-26k, 07/25-39k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8fad6cac-2e39-4a79-bbd3-48abd2b01ae1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117364404, 'registration': 'VO71HFZ', 'account': 'KIN032', 'make': 'VAUXHALL', 'model': 'CORSA ELECTRIC HATCHBACK', 'derivative': '100kW SE Nav Premium 50kWh 5dr Auto [7.4kWCh]', 'mileage': 45799, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-16', 'fuel': 'Electric', 'motExpiry': '2026-12-15', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/22-8k, 07/23-17k, 06/24-26k, 07/25-39k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8fad6cac-2e39-4a79-bbd3-48abd2b01ae1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340a7600-bfa4-575a-95a8-50664bda819f with identifier: 117364404
2025-11-27 19:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340a7600-bfa4-575a-95a8-50664bda819f with scrape type 1
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Fe7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/bde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252Fa2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fd1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e962910>
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fb41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/b41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec2df90>
2025-11-27 19:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/f6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:04:37 [astonbarclay.gb] INFO: Found listing with ID: 117554554
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554554%27 HTTP/1.1" 200 None
2025-11-27 19:04:37 [astonbarclay.gb] INFO: Scrape type for 117554554: 1
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Feecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea98610>
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb03690>
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd99d90>
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252Fd1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/d1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252Febaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252F3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb5a710>
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Ffd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/fd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb58910>
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252F0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:04:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554606, 'registration': 'YP67UAM', 'account': 'ARN185', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 D5 PowerPulse Inscription Pro 5dr AWD G tronic', 'mileage': 68592, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 21k, 30k, 37k, 50k, 64k, 68k,', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554606, 'registration': 'YP67UAM', 'account': 'ARN185', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 D5 PowerPulse Inscription Pro 5dr AWD G tronic', 'mileage': 68592, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 21k, 30k, 37k, 50k, 64k, 68k,', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2960b51-a9cc-5808-8d9b-3e2a4d21df43 with identifier: 117554606
2025-11-27 19:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2960b51-a9cc-5808-8d9b-3e2a4d21df43 with scrape type 1
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e2960b51-a9cc-5808-8d9b-3e2a4d21df43
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e2960b51-a9cc-5808-8d9b-3e2a4d21df43
2025-11-27 19:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e2960b51-a9cc-5808-8d9b-3e2a4d21df43, identifier: 117554606
2025-11-27 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/a0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:04:38 [astonbarclay.gb] INFO: Found listing with ID: 117554643
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554643%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [astonbarclay.gb] INFO: Scrape type for 117554643: 1
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252Feac08488-fa88-4546-b35d-4682461096f2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/eac08488-fa88-4546-b35d-4682461096f2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Fa0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e2960b51-a9cc-5808-8d9b-3e2a4d21df43 with identifier: 117554606
2025-11-27 19:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e2960b51-a9cc-5808-8d9b-3e2a4d21df43 with identifier: 117554606
2025-11-27 19:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e2960b51-a9cc-5808-8d9b-3e2a4d21df43 with identifier: 117554606 to the API
2025-11-27 19:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e2960b51-a9cc-5808-8d9b-3e2a4d21df43%27 HTTP/1.1" 200 None
2025-11-27 19:04:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e2960b51-a9cc-5808-8d9b-3e2a4d21df43: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554606?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e2960b51-a9cc-5808-8d9b-3e2a4d21df43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP67UAM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554606',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLVO',
 'model': 'XC90 DIESEL ESTATE',
 'odometer': 68592,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'VOLVO XC90 DIESEL ESTATE 2.0 D5 PowerPulse Inscription Pro 5dr AWD '
          'G tronic',
 'transmission': 'automatic',
 'trim': '2.0 D5 PowerPulse Inscription Pro 5dr AWD G tronic',
 'vin': None,
 'year': 2017}
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554606%27 HTTP/1.1" 200 None
2025-11-27 19:04:39 [astonbarclay.gb] INFO: Saving data for 117554606: {'created_time': 1764270279.244898, 'last_price_update_time': 1764270279.244907, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554606') HTTP/1.1" 204 0
2025-11-27 19:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feea110>
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252Fcaf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea68f10>
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252Fbde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/bde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe416d0>
2025-11-27 19:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/a620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fc1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e996950>
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c350750>
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Ff6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/f6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec42a50>
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252Fd56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:04:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117242484, 'registration': 'AF71YCM', 'account': 'KIN032', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW Active Premium 50kWh 5dr Auto', 'mileage': 36272, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-05', 'fuel': 'Electric', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/22 6K 02/23 14K 11/23 23K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97ed1c2b-70d6-4735-931f-bf32c05ad8eb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117242484, 'registration': 'AF71YCM', 'account': 'KIN032', 'make': 'PEUGEOT', 'model': 'E-2008 ELECTRIC ESTATE', 'derivative': '100kW Active Premium 50kWh 5dr Auto', 'mileage': 36272, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-05', 'fuel': 'Electric', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/22 6K 02/23 14K 11/23 23K', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97ed1c2b-70d6-4735-931f-bf32c05ad8eb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94218730-f333-5cb1-bc52-8c3e9c5a1407 with identifier: 117242484
2025-11-27 19:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94218730-f333-5cb1-bc52-8c3e9c5a1407 with scrape type 1
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:04:41 [astonbarclay.gb] INFO: Found listing with ID: 117554665
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554665%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [astonbarclay.gb] INFO: Scrape type for 117554665: 1
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F88de37ba-8063-4916-97d2-830491c22251_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/88de37ba-8063-4916-97d2-830491c22251_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80a510>
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/cdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117264969?view=catalogue)
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fb0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Ff0254274-cc89-4e99-af98-7514144342c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec25e50>
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252Ff30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaa5650>
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaa53d0>
2025-11-27 19:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252Fa0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/a0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e832e90>
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:04:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117209040, 'registration': 'KM72EJJ', 'account': 'KIN032', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '125kW Premium 58 kWh 5dr Auto', 'mileage': 52656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-04', 'fuel': 'Electric', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24-23k, 02/25-41k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4426de3c-62ba-4f8f-854e-cce5cfc132de.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117209040, 'registration': 'KM72EJJ', 'account': 'KIN032', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '125kW Premium 58 kWh 5dr Auto', 'mileage': 52656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-04', 'fuel': 'Electric', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24-23k, 02/25-41k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4426de3c-62ba-4f8f-854e-cce5cfc132de.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41ae796-efd0-5c70-b725-bddc08ebb3fd with identifier: 117209040
2025-11-27 19:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41ae796-efd0-5c70-b725-bddc08ebb3fd with scrape type 1
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Fbc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:42 [astonbarclay.gb] INFO: Found listing with ID: 117554866
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554866%27 HTTP/1.1" 200 None
2025-11-27 19:04:42 [astonbarclay.gb] INFO: Scrape type for 117554866: 1
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e934650>
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d1bf8d0>
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252Fa620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/a620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d411d10>
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252F5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252F4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Fcb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3fd10>
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:43 [astonbarclay.gb] INFO: Found listing with ID: 117554653
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554653%27 HTTP/1.1" 200 None
2025-11-27 19:04:43 [astonbarclay.gb] INFO: Scrape type for 117554653: 1
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Feb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c373ad0>
2025-11-27 19:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Fe7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea03010>
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252Fcdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/cdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3d690>
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fd1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecae110>
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOY71KYZ%252F2025-11-18%252Fimage%252F0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d
2025-11-27 19:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2afae0b-e1d1-5d56-9607-b6f19bb0877d, skipping ID generation
2025-11-27 19:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d with scrape type 1
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c2afae0b-e1d1-5d56-9607-b6f19bb0877d from tracking dictionaries
2025-11-27 19:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2afae0b-e1d1-5d56-9607-b6f19bb0877d sending to next pipeline
2025-11-27 19:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2afae0b-e1d1-5d56-9607-b6f19bb0877d, identifier: 117264969
2025-11-27 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/d1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252F0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Ff0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2afae0b-e1d1-5d56-9607-b6f19bb0877d with identifier: 117264969
2025-11-27 19:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2afae0b-e1d1-5d56-9607-b6f19bb0877d with identifier: 117264969
2025-11-27 19:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c2afae0b-e1d1-5d56-9607-b6f19bb0877d with identifier: 117264969 to the API
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c2afae0b-e1d1-5d56-9607-b6f19bb0877d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OY71KYZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117264969',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL ESTATE',
 'odometer': 43944,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31188,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/93960fb8-251a-4230-8d73-5e3e3d19e903_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28640,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/f06f6b9a-6525-4f87-b1fb-899353c15b44_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31677,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/ad528dc9-974c-4b11-9640-8bf3433fed9a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34093,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/7cd11ae4-f548-4af5-b030-893f023e8d0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46842,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/fd88e66f-b34f-45f6-956b-c7dc2c40af57_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47215,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/40098231-a1e9-4d34-89b0-7f649876d1a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63437,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/a0db9a23-1204-464f-b39d-f245d3882404_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2afae0b-e1d1-5d56-9607-b6f19bb0877d/c2afae0b-e1d1-5d56-9607-b6f19bb0877d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51023,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OY71KYZ/2025-11-18/image/0fddaff6-c06f-45e3-9a15-68a806f63460_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seller_name': 'Kinto',
 'title': 'SKODA OCTAVIA DIESEL ESTATE 2.0 TDI SE Technology 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI SE Technology 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117264969%27 HTTP/1.1" 200 None
2025-11-27 19:04:45 [astonbarclay.gb] INFO: Saving data for 117264969: {'created_time': 1764270285.578937, 'last_price_update_time': 1764270285.578947, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117264969') HTTP/1.1" 204 0
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e939690>
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb13250>
2025-11-27 19:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Feecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0e050>
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252Fa2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:46 [astonbarclay.gb] INFO: Found listing with ID: 117554737
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554737%27 HTTP/1.1" 200 None
2025-11-27 19:04:46 [astonbarclay.gb] INFO: Scrape type for 117554737: 1
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252Fbcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/bcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554554?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac3310>
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/88de37ba-8063-4916-97d2-830491c22251_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Ff852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fb4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Fbf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550564?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb5a410>
2025-11-27 19:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3f590>
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252F3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaa6950>
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252Febaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:47 [astonbarclay.gb] INFO: Found listing with ID: 117554620
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554620%27 HTTP/1.1" 200 None
2025-11-27 19:04:47 [astonbarclay.gb] INFO: Scrape type for 117554620: 1
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e950850>
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9db190>
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Fa0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb6ee90>
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fc1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e992e90>
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252Fd1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/d1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252F58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb6d50>
2025-11-27 19:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554554, 'registration': 'BG69DGF', 'account': 'ARN185', 'make': 'SEAT', 'model': 'LEON SPORT TOURER', 'derivative': '1.5 TSI EVO 150 FR [EZ] 5dr', 'mileage': 92831, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 55k, 79k, 80k, 89k', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554554, 'registration': 'BG69DGF', 'account': 'ARN185', 'make': 'SEAT', 'model': 'LEON SPORT TOURER', 'derivative': '1.5 TSI EVO 150 FR [EZ] 5dr', 'mileage': 92831, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-05-11', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 55k, 79k, 80k, 89k', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e645c0a-9240-5b26-beba-c999950e26f7 with identifier: 117554554
2025-11-27 19:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e645c0a-9240-5b26-beba-c999950e26f7 with scrape type 1
2025-11-27 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9e645c0a-9240-5b26-beba-c999950e26f7
2025-11-27 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9e645c0a-9240-5b26-beba-c999950e26f7
2025-11-27 19:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9e645c0a-9240-5b26-beba-c999950e26f7, identifier: 117554554
2025-11-27 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:49 [astonbarclay.gb] INFO: Found listing with ID: 117554834
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554834%27 HTTP/1.1" 200 None
2025-11-27 19:04:49 [astonbarclay.gb] INFO: Scrape type for 117554834: 1
2025-11-27 19:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554665?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9e645c0a-9240-5b26-beba-c999950e26f7 with identifier: 117554554
2025-11-27 19:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9e645c0a-9240-5b26-beba-c999950e26f7 with identifier: 117554554
2025-11-27 19:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9e645c0a-9240-5b26-beba-c999950e26f7 with identifier: 117554554 to the API
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279e645c0a-9240-5b26-beba-c999950e26f7%27 HTTP/1.1" 200 None
2025-11-27 19:04:49 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9e645c0a-9240-5b26-beba-c999950e26f7: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:49 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554554?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9e645c0a-9240-5b26-beba-c999950e26f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG69DGF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554554',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SEAT',
 'model': 'LEON SPORT TOURER',
 'odometer': 92831,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-25',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'SEAT LEON SPORT TOURER 1.5 TSI EVO 150 FR [EZ] 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO 150 FR [EZ] 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554554%27 HTTP/1.1" 200 None
2025-11-27 19:04:49 [astonbarclay.gb] INFO: Saving data for 117554554: {'created_time': 1764270289.649552, 'last_price_update_time': 1764270289.649562, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554554') HTTP/1.1" 204 0
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb46950>
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F88de37ba-8063-4916-97d2-830491c22251_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/88de37ba-8063-4916-97d2-830491c22251_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d147550>
2025-11-27 19:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550544, 'registration': 'DX66WXO', 'account': 'KEN008', 'make': 'VAUXHALL', 'model': 'MERIVA ESTATE', 'derivative': '1.4T 16V SE 5dr Auto', 'mileage': 39645, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-10-15', 'fuel': 'Petrol', 'motExpiry': '2026-10-14', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': None, 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 15k 17k 20k 24k 28k 32k 38k', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550544, 'registration': 'DX66WXO', 'account': 'KEN008', 'make': 'VAUXHALL', 'model': 'MERIVA ESTATE', 'derivative': '1.4T 16V SE 5dr Auto', 'mileage': 39645, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-10-15', 'fuel': 'Petrol', 'motExpiry': '2026-10-14', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': None, 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 15k 17k 20k 24k 28k 32k 38k', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 166, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89 with identifier: 117550544
2025-11-27 19:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89 with scrape type 1
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89
2025-11-27 19:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89, identifier: 117550544
2025-11-27 19:04:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550564, 'registration': 'KU16ZGN', 'account': 'KEN008', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS ESTATE', 'derivative': 'C200 SE Executive 5dr Auto', 'mileage': 62325, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-11', 'fuel': 'Petrol', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 26k 34k 37k 42k 47k 53k 58k', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550564, 'registration': 'KU16ZGN', 'account': 'KEN008', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS ESTATE', 'derivative': 'C200 SE Executive 5dr Auto', 'mileage': 62325, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-11', 'fuel': 'Petrol', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 26k 34k 37k 42k 47k 53k 58k', 'virtual': False, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf64b693-1936-50a3-aa9e-a642221b5cc8 with identifier: 117550564
2025-11-27 19:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf64b693-1936-50a3-aa9e-a642221b5cc8 with scrape type 1
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item bf64b693-1936-50a3-aa9e-a642221b5cc8
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item bf64b693-1936-50a3-aa9e-a642221b5cc8
2025-11-27 19:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bf64b693-1936-50a3-aa9e-a642221b5cc8, identifier: 117550564
2025-11-27 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fa0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89 with identifier: 117550544
2025-11-27 19:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89 with identifier: 117550544
2025-11-27 19:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89 with identifier: 117550544 to the API
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89%27 HTTP/1.1" 200 None
2025-11-27 19:04:50 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:50 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'BROWN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ddb51b8e-1c8b-5a7f-8c78-7e54258c8d89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DX66WXO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550544',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'MERIVA ESTATE',
 'odometer': 39645,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-15',
 'seller_name': 'Ken Jervis Kia',
 'title': 'VAUXHALL MERIVA ESTATE 1.4T 16V SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4T 16V SE 5dr Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550544%27 HTTP/1.1" 200 None
2025-11-27 19:04:50 [astonbarclay.gb] INFO: Saving data for 117550544: {'created_time': 1764270290.747229, 'last_price_update_time': 1764270290.747239, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550544') HTTP/1.1" 204 0
2025-11-27 19:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bf64b693-1936-50a3-aa9e-a642221b5cc8 with identifier: 117550564
2025-11-27 19:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bf64b693-1936-50a3-aa9e-a642221b5cc8 with identifier: 117550564
2025-11-27 19:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bf64b693-1936-50a3-aa9e-a642221b5cc8 with identifier: 117550564 to the API
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27bf64b693-1936-50a3-aa9e-a642221b5cc8%27 HTTP/1.1" 200 None
2025-11-27 19:04:51 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id bf64b693-1936-50a3-aa9e-a642221b5cc8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:50 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550564?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bf64b693-1936-50a3-aa9e-a642221b5cc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KU16ZGN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550564',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS ESTATE',
 'odometer': 62325,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-11',
 'seller_name': 'Ken Jervis Kia',
 'title': 'MERCEDES-BENZ C CLASS ESTATE C200 SE Executive 5dr Auto',
 'transmission': 'automatic',
 'trim': 'C200 SE Executive 5dr Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550564%27 HTTP/1.1" 200 None
2025-11-27 19:04:51 [astonbarclay.gb] INFO: Saving data for 117550564: {'created_time': 1764270291.075105, 'last_price_update_time': 1764270291.075115, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550564') HTTP/1.1" 204 0
2025-11-27 19:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c7247d0>
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Fbc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd2e6d0>
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecebc90>
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea5ab50>
2025-11-27 19:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/bcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:52 [astonbarclay.gb] INFO: Found listing with ID: 117554783
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554783%27 HTTP/1.1" 200 None
2025-11-27 19:04:52 [astonbarclay.gb] INFO: Scrape type for 117554783: 1
2025-11-27 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554866?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3ba50>
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252F4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e953810>
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Fcb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c33f310>
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252F5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaaf750>
2025-11-27 19:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554665, 'registration': 'YM69KTU', 'account': 'MAZ084', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.4 Boosterjet Sport 5dr', 'mileage': 72893, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-16', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 24k, 41k, 41k, 56k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554665, 'registration': 'YM69KTU', 'account': 'MAZ084', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.4 Boosterjet Sport 5dr', 'mileage': 72893, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-16', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 24k, 41k, 41k, 56k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f4e5b8b-20eb-520b-b9c6-9ae6130981da with identifier: 117554665
2025-11-27 19:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f4e5b8b-20eb-520b-b9c6-9ae6130981da with scrape type 1
2025-11-27 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5f4e5b8b-20eb-520b-b9c6-9ae6130981da
2025-11-27 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5f4e5b8b-20eb-520b-b9c6-9ae6130981da
2025-11-27 19:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5f4e5b8b-20eb-520b-b9c6-9ae6130981da, identifier: 117554665
2025-11-27 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364404?view=catalogue)
2025-11-27 19:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:04:53 [astonbarclay.gb] INFO: Found listing with ID: 117554799
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554799%27 HTTP/1.1" 200 None
2025-11-27 19:04:53 [astonbarclay.gb] INFO: Scrape type for 117554799: 1
2025-11-27 19:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5f4e5b8b-20eb-520b-b9c6-9ae6130981da with identifier: 117554665
2025-11-27 19:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5f4e5b8b-20eb-520b-b9c6-9ae6130981da with identifier: 117554665
2025-11-27 19:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5f4e5b8b-20eb-520b-b9c6-9ae6130981da with identifier: 117554665 to the API
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275f4e5b8b-20eb-520b-b9c6-9ae6130981da%27 HTTP/1.1" 200 None
2025-11-27 19:04:53 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5f4e5b8b-20eb-520b-b9c6-9ae6130981da: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554665?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5f4e5b8b-20eb-520b-b9c6-9ae6130981da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YM69KTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554665',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SUZUKI',
 'model': 'SWIFT HATCHBACK',
 'odometer': 72893,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': 'Arnold Clark',
 'title': 'SUZUKI SWIFT HATCHBACK 1.4 Boosterjet Sport 5dr',
 'transmission': 'manual',
 'trim': '1.4 Boosterjet Sport 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554665%27 HTTP/1.1" 200 None
2025-11-27 19:04:53 [astonbarclay.gb] INFO: Saving data for 117554665: {'created_time': 1764270293.551474, 'last_price_update_time': 1764270293.551485, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554665') HTTP/1.1" 204 0
2025-11-27 19:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e901310>
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252Feb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb874d0>
2025-11-27 19:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Ff0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea45d90>
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252F0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e92c550>
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e901150>
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252Fbcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/bcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdeb550>
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554866, 'registration': 'CX71ZTE', 'account': 'ARN096', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech Active Premium 5dr', 'mileage': 45908, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-11-23', 'fuel': 'Petrol', 'motExpiry': '2025-12-02', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 41k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554866, 'registration': 'CX71ZTE', 'account': 'ARN096', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech Active Premium 5dr', 'mileage': 45908, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-11-23', 'fuel': 'Petrol', 'motExpiry': '2025-12-02', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 41k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6019982-86ed-52c5-b1b8-91c6c1a7a8ff with identifier: 117554866
2025-11-27 19:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6019982-86ed-52c5-b1b8-91c6c1a7a8ff with scrape type 1
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b6019982-86ed-52c5-b1b8-91c6c1a7a8ff
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b6019982-86ed-52c5-b1b8-91c6c1a7a8ff
2025-11-27 19:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b6019982-86ed-52c5-b1b8-91c6c1a7a8ff, identifier: 117554866
2025-11-27 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:04:55 [astonbarclay.gb] INFO: Found listing with ID: 117369086
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117369086%27 HTTP/1.1" 200 None
2025-11-27 19:04:55 [astonbarclay.gb] INFO: Scrape type for 117369086: 1
2025-11-27 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554737?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554653?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b6019982-86ed-52c5-b1b8-91c6c1a7a8ff with identifier: 117554866
2025-11-27 19:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b6019982-86ed-52c5-b1b8-91c6c1a7a8ff with identifier: 117554866
2025-11-27 19:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b6019982-86ed-52c5-b1b8-91c6c1a7a8ff with identifier: 117554866 to the API
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b6019982-86ed-52c5-b1b8-91c6c1a7a8ff%27 HTTP/1.1" 200 None
2025-11-27 19:04:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b6019982-86ed-52c5-b1b8-91c6c1a7a8ff: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:55 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554866?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b6019982-86ed-52c5-b1b8-91c6c1a7a8ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CX71ZTE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554866',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PEUGEOT',
 'model': '5008 ESTATE',
 'odometer': 45908,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': 'Arnold Clark',
 'title': 'PEUGEOT 5008 ESTATE 1.2 PureTech Active Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Active Premium 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554866%27 HTTP/1.1" 200 None
2025-11-27 19:04:55 [astonbarclay.gb] INFO: Saving data for 117554866: {'created_time': 1764270295.737817, 'last_price_update_time': 1764270295.737829, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554866') HTTP/1.1" 204 0
2025-11-27 19:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece2050>
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9b9d90>
2025-11-27 19:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117364152?view=catalogue)
2025-11-27 19:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue)
2025-11-27 19:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb8e850>
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252F34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb80290>
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252Fbf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea59990>
2025-11-27 19:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVO71HFZ%252F2025-11-20%252Fimage%252F6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 340a7600-bfa4-575a-95a8-50664bda819f
2025-11-27 19:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 340a7600-bfa4-575a-95a8-50664bda819f, skipping ID generation
2025-11-27 19:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340a7600-bfa4-575a-95a8-50664bda819f with scrape type 1
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 340a7600-bfa4-575a-95a8-50664bda819f from tracking dictionaries
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 340a7600-bfa4-575a-95a8-50664bda819f sending to next pipeline
2025-11-27 19:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 340a7600-bfa4-575a-95a8-50664bda819f, identifier: 117364404
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec78f10>
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fb4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117277530?view=catalogue)
2025-11-27 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:04:57 [astonbarclay.gb] INFO: Found listing with ID: 117459261
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459261%27 HTTP/1.1" 200 None
2025-11-27 19:04:57 [astonbarclay.gb] INFO: Scrape type for 117459261: 0
2025-11-27 19:04:57 [astonbarclay.gb] INFO: Found listing with ID: 117402247
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402247%27 HTTP/1.1" 200 None
2025-11-27 19:04:57 [astonbarclay.gb] INFO: Scrape type for 117402247: 1
2025-11-27 19:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 340a7600-bfa4-575a-95a8-50664bda819f with identifier: 117364404
2025-11-27 19:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 340a7600-bfa4-575a-95a8-50664bda819f with identifier: 117364404
2025-11-27 19:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'vauxhall corsa electric hatchback 100kw se nav premium 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 45799, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-16', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364404', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw se nav premium 50kwh 5dr auto [7.4kwch]', 'license_plate': 'vo71hfz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '340a7600-bfa4-575a-95a8-50664bda819f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 21358}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 22536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 19256}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 19940}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 44977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 33926}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43239}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43007}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'vauxhall corsa electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 73706} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '340a7600-bfa4-575a-95a8-50664bda819f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vo71hfz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364404',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa electric hatchback',
     'model': 'corsa electric hatchback',
     'odometer': 45799,
     'odometer_in_km': 73706,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21358,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22536,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 19256,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 19940,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44977,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33926,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43239,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43007,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-16',
     'sanitized_make': 'vauxhall',
     'seller_name': 'kinto',
     'title': 'vauxhall corsa electric hatchback 100kw se nav premium '
              '50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw se nav premium 50kwh 5dr auto [7.4kwch]',
     'vin': None,
     'year': 2021}
2025-11-27 19:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 340a7600-bfa4-575a-95a8-50664bda819f spider: astonbarclay.gb
2025-11-27 19:04:57 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 340a7600-bfa4-575a-95a8-50664bda819f due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'vauxhall corsa electric hatchback 100kw se nav premium 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 45799, 'odometer_reading_unit': 'mi', 'registration_date': '2021-12-16', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364404', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw se nav premium 50kwh 5dr auto [7.4kwch]', 'license_plate': 'vo71hfz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '340a7600-bfa4-575a-95a8-50664bda819f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 21358}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 22536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 19256}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 19940}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 44977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 33926}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43239}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43007}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'vauxhall corsa electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 73706} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '340a7600-bfa4-575a-95a8-50664bda819f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vo71hfz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364404',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa electric hatchback',
     'model': 'corsa electric hatchback',
     'odometer': 45799,
     'odometer_in_km': 73706,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21358,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 22536,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 19256,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 19940,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44977,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33926,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43239,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43007,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-12-16',
     'sanitized_make': 'vauxhall',
     'seller_name': 'kinto',
     'title': 'vauxhall corsa electric hatchback 100kw se nav premium '
              '50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw se nav premium 50kwh 5dr auto [7.4kwch]',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '340a7600-bfa4-575a-95a8-50664bda819f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VO71HFZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364404',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'CORSA ELECTRIC HATCHBACK',
 'odometer': 45799,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21358,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/e7f455d5-c54a-4617-a628-407c85dfd858_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22536,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eecf77a6-3c4f-436c-b934-08e83a84bb42_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19256,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/a0de7be8-4429-4698-905f-8148e363a77d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19940,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3fb7302b-7772-42da-a0b2-dfc8a28fec7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44977,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/858099b8-7b4d-4609-8ff8-d857cffc5ccb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33926,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/eb863eb2-9024-4d6a-83c4-fc6c5d9a1b58_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43239,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/3814bd37-6a10-4590-806a-a003d7dd5cb6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340a7600-bfa4-575a-95a8-50664bda819f/340a7600-bfa4-575a-95a8-50664bda819f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43007,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/VO71HFZ/2025-11-20/image/6089f794-bcb0-4fe7-96f4-663409132630_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seller_name': 'Kinto',
 'title': 'VAUXHALL CORSA ELECTRIC HATCHBACK 100kW SE Nav Premium 50kWh 5dr '
          'Auto [7.4kWCh]',
 'transmission': 'automatic',
 'trim': '100kW SE Nav Premium 50kWh 5dr Auto [7.4kWCh]',
 'vin': None,
 'year': 2021}
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364404%27 HTTP/1.1" 200 None
2025-11-27 19:04:57 [astonbarclay.gb] INFO: Saving data for 117364404: {'created_time': 1764270297.733135, 'last_price_update_time': 1764270297.733146, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117364404') HTTP/1.1" 204 0
2025-11-27 19:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c33edd0>
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/eac08488-fa88-4546-b35d-4682461096f2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402830?view=catalogue)
2025-11-27 19:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb8f7d0>
2025-11-27 19:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Ff852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c34a8d0>
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Ff0254274-cc89-4e99-af98-7514144342c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea84cd0>
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252F58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554737, 'registration': 'VGZ4437', 'account': 'ARN185', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive30d M Sport 5dr Auto [7 Seat]', 'mileage': 54644, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-08-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 36k, 40k, 45k, 51k,', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554737, 'registration': 'VGZ4437', 'account': 'ARN185', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive30d M Sport 5dr Auto [7 Seat]', 'mileage': 54644, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-08-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-09', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 36k, 40k, 45k, 51k,', 'virtual': False, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502056e5-1991-5d9d-8445-75421901f6e6 with identifier: 117554737
2025-11-27 19:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502056e5-1991-5d9d-8445-75421901f6e6 with scrape type 1
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 502056e5-1991-5d9d-8445-75421901f6e6
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 502056e5-1991-5d9d-8445-75421901f6e6
2025-11-27 19:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 502056e5-1991-5d9d-8445-75421901f6e6, identifier: 117554737
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554653, 'registration': 'GN21VBE', 'account': 'ARN175', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line 5dr Auto', 'mileage': 28910, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-03-10', 'fuel': 'Petrol', 'motExpiry': '2026-09-18', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 70k, 12k, 18k, 23k, 28k VOSA DISCREPANCY', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554653, 'registration': 'GN21VBE', 'account': 'ARN175', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line 5dr Auto', 'mileage': 28910, 'mileageWarranty': False, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-03-10', 'fuel': 'Petrol', 'motExpiry': '2026-09-18', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 70k, 12k, 18k, 23k, 28k VOSA DISCREPANCY', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 292de46d-3120-5c0f-aefd-05c0584f7ff8 with identifier: 117554653
2025-11-27 19:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 292de46d-3120-5c0f-aefd-05c0584f7ff8 with scrape type 1
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 292de46d-3120-5c0f-aefd-05c0584f7ff8
2025-11-27 19:04:58 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 292de46d-3120-5c0f-aefd-05c0584f7ff8
2025-11-27 19:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 292de46d-3120-5c0f-aefd-05c0584f7ff8, identifier: 117554653
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Found listing with ID: 117422017
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422017%27 HTTP/1.1" 200 None
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Scrape type for 117422017: 0
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Found listing with ID: 117327029
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117327029%27 HTTP/1.1" 200 None
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Scrape type for 117327029: 0
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Found listing with ID: 117120453
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120453%27 HTTP/1.1" 200 None
2025-11-27 19:04:58 [astonbarclay.gb] INFO: Scrape type for 117120453: 2
2025-11-27 19:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 502056e5-1991-5d9d-8445-75421901f6e6 with identifier: 117554737
2025-11-27 19:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 502056e5-1991-5d9d-8445-75421901f6e6 with identifier: 117554737
2025-11-27 19:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 502056e5-1991-5d9d-8445-75421901f6e6 with identifier: 117554737 to the API
2025-11-27 19:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27502056e5-1991-5d9d-8445-75421901f6e6%27 HTTP/1.1" 200 None
2025-11-27 19:04:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 502056e5-1991-5d9d-8445-75421901f6e6: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:58 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554737?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '502056e5-1991-5d9d-8445-75421901f6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VGZ4437',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554737',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'BMW',
 'model': 'X5 DIESEL ESTATE',
 'odometer': 54644,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'BMW X5 DIESEL ESTATE xDrive30d M Sport 5dr Auto [7 Seat]',
 'transmission': 'automatic',
 'trim': 'xDrive30d M Sport 5dr Auto [7 Seat]',
 'vin': None,
 'year': 2017}
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554737%27 HTTP/1.1" 200 None
2025-11-27 19:04:59 [astonbarclay.gb] INFO: Saving data for 117554737: {'created_time': 1764270299.158453, 'last_price_update_time': 1764270299.158461, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554737') HTTP/1.1" 204 0
2025-11-27 19:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 292de46d-3120-5c0f-aefd-05c0584f7ff8 with identifier: 117554653
2025-11-27 19:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 292de46d-3120-5c0f-aefd-05c0584f7ff8 with identifier: 117554653
2025-11-27 19:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 292de46d-3120-5c0f-aefd-05c0584f7ff8 with identifier: 117554653 to the API
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27292de46d-3120-5c0f-aefd-05c0584f7ff8%27 HTTP/1.1" 200 None
2025-11-27 19:04:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 292de46d-3120-5c0f-aefd-05c0584f7ff8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:04:59 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554653?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '292de46d-3120-5c0f-aefd-05c0584f7ff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GN21VBE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554653',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 28910,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seller_name': 'Arnold Clark',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A200 AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A200 AMG Line 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554653%27 HTTP/1.1" 200 None
2025-11-27 19:04:59 [astonbarclay.gb] INFO: Saving data for 117554653: {'created_time': 1764270299.555779, 'last_price_update_time': 1764270299.555789, 'auction_closing_time': 1764842400.0}
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554653') HTTP/1.1" 204 0
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c34b890>
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600 saved to cache
2025-11-27 19:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec1a890>
2025-11-27 19:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX73PTZ%252F2025-11-24%252Fimage%252Fb0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd9b4b06-b257-5599-bc08-83bd16e26e40
2025-11-27 19:05:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd9b4b06-b257-5599-bc08-83bd16e26e40, skipping ID generation
2025-11-27 19:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9b4b06-b257-5599-bc08-83bd16e26e40 with scrape type 1
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cd9b4b06-b257-5599-bc08-83bd16e26e40 from tracking dictionaries
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd9b4b06-b257-5599-bc08-83bd16e26e40 sending to next pipeline
2025-11-27 19:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cd9b4b06-b257-5599-bc08-83bd16e26e40, identifier: 117364152
2025-11-27 19:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb07090>
2025-11-27 19:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV22UNN%252F2025-11-25%252Fimage%252F3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550
2025-11-27 19:05:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d959fa5-65a5-5ff1-adc4-571dd55e1550, skipping ID generation
2025-11-27 19:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with scrape type 1
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8d959fa5-65a5-5ff1-adc4-571dd55e1550 from tracking dictionaries
2025-11-27 19:05:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550 sending to next pipeline
2025-11-27 19:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d959fa5-65a5-5ff1-adc4-571dd55e1550, identifier: 117329064
2025-11-27 19:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099210?view=catalogue)
2025-11-27 19:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue)
2025-11-27 19:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/d25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117242484?view=catalogue)
2025-11-27 19:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cd9b4b06-b257-5599-bc08-83bd16e26e40 with identifier: 117364152
2025-11-27 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cd9b4b06-b257-5599-bc08-83bd16e26e40 with identifier: 117364152
2025-11-27 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line prem plus 66.5kwh 5dr at', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqb estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17639, 'odometer_reading_unit': 'mi', 'registration_date': '2023-09-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364152', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqb 350 4m 215kw amg line prem plus 66.5kwh 5dr at', 'license_plate': 'fx73ptz', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'cd9b4b06-b257-5599-bc08-83bd16e26e40', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 25913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27379}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43339}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 52005}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 44157}], 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'mercedes-benz eqb estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 28387} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'cd9b4b06-b257-5599-bc08-83bd16e26e40',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fx73ptz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364152',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqb estate',
     'model': 'eqb estate',
     'odometer': 17639,
     'odometer_in_km': 28387,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25913,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27575,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27379,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27139,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48668,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43339,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52005,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44157,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-09-08',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line prem '
              'plus 66.5kwh 5dr at',
     'transmission': 'automatic',
     'trim': 'eqb 350 4m 215kw amg line prem plus 66.5kwh 5dr at',
     'vin': None,
     'year': 2023}
2025-11-27 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: cd9b4b06-b257-5599-bc08-83bd16e26e40 spider: astonbarclay.gb
2025-11-27 19:05:00 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: cd9b4b06-b257-5599-bc08-83bd16e26e40 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line prem plus 66.5kwh 5dr at', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqb estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17639, 'odometer_reading_unit': 'mi', 'registration_date': '2023-09-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364152', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqb 350 4m 215kw amg line prem plus 66.5kwh 5dr at', 'license_plate': 'fx73ptz', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'cd9b4b06-b257-5599-bc08-83bd16e26e40', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 25913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27379}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 27139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 48668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 43339}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 52005}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 44157}], 'current_year_diff': 2, 'age_in_months': 26, 'make_model': 'mercedes-benz eqb estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 28387} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'cd9b4b06-b257-5599-bc08-83bd16e26e40',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fx73ptz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364152',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqb estate',
     'model': 'eqb estate',
     'odometer': 17639,
     'odometer_in_km': 28387,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25913,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27575,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27379,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 27139,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48668,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 43339,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52005,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44157,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-09-08',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqb estate eqb 350 4m 215kw amg line prem '
              'plus 66.5kwh 5dr at',
     'transmission': 'automatic',
     'trim': 'eqb 350 4m 215kw amg line prem plus 66.5kwh 5dr at',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'cd9b4b06-b257-5599-bc08-83bd16e26e40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FX73PTZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117364152',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQB ESTATE',
 'odometer': 17639,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25913,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/ac546b44-5ae7-4936-b966-ff85b1abc943_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27575,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/d1e3c2af-e783-4ab1-9ee8-4a2d736172bc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27379,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/3d5d26ba-ffed-44bc-965d-4ace9313f44a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27139,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/c1df7491-2b64-4d6b-8646-09beb620a423_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48668,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/b0b7525b-3529-4b09-9d0a-526bd106bd2e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43339,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/5b1cfd7f-b742-49b1-8b05-5d99da83b235_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52005,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/0da10a4e-b18a-4086-b573-9c93d6d046d0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd9b4b06-b257-5599-bc08-83bd16e26e40/cd9b4b06-b257-5599-bc08-83bd16e26e40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44157,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/FX73PTZ/2025-11-24/image/f852eae1-6c0e-41b5-b7f2-25e74a10af84_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-08',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQB ESTATE EQB 350 4M 215kW AMG Line Prem Plus '
          '66.5kWh 5dr At',
 'transmission': 'automatic',
 'trim': 'EQB 350 4M 215kW AMG Line Prem Plus 66.5kWh 5dr At',
 'vin': None,
 'year': 2023}
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364152%27 HTTP/1.1" 200 None
2025-11-27 19:05:00 [astonbarclay.gb] INFO: Saving data for 117364152: {'created_time': 1764270300.776454, 'last_price_update_time': 1764270300.776464, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117364152') HTTP/1.1" 204 0
2025-11-27 19:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with identifier: 117329064
2025-11-27 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with identifier: 117329064
2025-11-27 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'zs electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 9836, 'odometer_reading_unit': 'mi', 'registration_date': '2022-03-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117329064', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '130kw trophy ev 51kwh 5dr auto', 'license_plate': 'dv22unn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '8d959fa5-65a5-5ff1-adc4-571dd55e1550', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28699}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28851}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26784}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26765}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 21627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59917}], 'current_year_diff': 3, 'age_in_months': 43, 'make_model': 'mg motor uk zs electric hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 15829} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '8d959fa5-65a5-5ff1-adc4-571dd55e1550',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dv22unn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117329064',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk zs electric hatchback',
     'model': 'zs electric hatchback',
     'odometer': 9836,
     'odometer_in_km': 15829,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28699,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28851,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26784,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26765,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56281,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53427,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21627,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59917,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-03-31',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'kinto',
     'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '130kw trophy ev 51kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 spider: astonbarclay.gb
2025-11-27 19:05:01 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'zs electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 9836, 'odometer_reading_unit': 'mi', 'registration_date': '2022-03-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117329064', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '130kw trophy ev 51kwh 5dr auto', 'license_plate': 'dv22unn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '8d959fa5-65a5-5ff1-adc4-571dd55e1550', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28699}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28851}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26784}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 26765}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 21627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59917}], 'current_year_diff': 3, 'age_in_months': 43, 'make_model': 'mg motor uk zs electric hatchback', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 15829} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '8d959fa5-65a5-5ff1-adc4-571dd55e1550',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'dv22unn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117329064',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk zs electric hatchback',
     'model': 'zs electric hatchback',
     'odometer': 9836,
     'odometer_in_km': 15829,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28699,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28851,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26784,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26765,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56281,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53427,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21627,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59917,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-03-31',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'kinto',
     'title': 'mg motor uk zs electric hatchback 130kw trophy ev 51kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '130kw trophy ev 51kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '8d959fa5-65a5-5ff1-adc4-571dd55e1550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV22UNN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117329064',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'ZS ELECTRIC HATCHBACK',
 'odometer': 9836,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28699,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3c667856-0f1b-43fc-bc29-56090dcdae2b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28851,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/57aeb393-98d8-4deb-be23-7e5bfd5f7590_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26784,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/a2b20d38-b5dd-43e2-9fbb-72fce8707464_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26765,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/ebaa72e6-4242-4cd2-8656-127b03230509_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56281,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/8aa2c0c3-892e-4788-be3a-1e0e043c4494_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53427,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/3af97bcd-e039-4ea7-8908-8cdcbfe70592_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21627,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/2779c946-adba-48b7-9fb5-7f76562aabb7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d959fa5-65a5-5ff1-adc4-571dd55e1550/8d959fa5-65a5-5ff1-adc4-571dd55e1550_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59917,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV22UNN/2025-11-25/image/4f446925-db31-47d6-8be7-1e8d3bde9d46_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seller_name': 'Kinto',
 'title': 'MG MOTOR UK ZS ELECTRIC HATCHBACK 130kW Trophy EV 51kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '130kW Trophy EV 51kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117329064%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Saving data for 117329064: {'created_time': 1764270301.046389, 'last_price_update_time': 1764270301.046401, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117329064') HTTP/1.1" 204 0
2025-11-27 19:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9ebed0>
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY20FRF%252F2025-11-25%252Fimage%252F3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd4bee19-35a9-52eb-a2fc-cf1767839301
2025-11-27 19:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd4bee19-35a9-52eb-a2fc-cf1767839301, skipping ID generation
2025-11-27 19:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4bee19-35a9-52eb-a2fc-cf1767839301 with scrape type 1
2025-11-27 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bd4bee19-35a9-52eb-a2fc-cf1767839301 from tracking dictionaries
2025-11-27 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd4bee19-35a9-52eb-a2fc-cf1767839301 sending to next pipeline
2025-11-27 19:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bd4bee19-35a9-52eb-a2fc-cf1767839301, identifier: 117277530
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e988d90>
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fa0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/cac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117119906
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117119906%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117119906: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117253368
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253368%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117253368: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117179358
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117179358%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117179358: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117103708
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103708%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117103708: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117140308
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140308%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117140308: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117230187
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117230187%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117230187: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117242944
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242944%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117242944: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117242472
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242472%27 HTTP/1.1" 200 None
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Scrape type for 117242472: 0
2025-11-27 19:05:01 [astonbarclay.gb] INFO: Found listing with ID: 117539707
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539707%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117539707: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117273524
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273524%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117273524: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117362589
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362589%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117362589: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117400056
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400056%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117400056: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 116879417
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116879417%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 116879417: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117208422
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117208422%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117208422: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117214479
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214479%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117214479: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117394554
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394554%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117394554: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117271012
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271012%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117271012: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117194162
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117194162%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117194162: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117178030
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178030%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117178030: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117372557
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372557%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117372557: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117118656
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117118656%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117118656: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117120682
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120682%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117120682: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117491120
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491120%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117491120: 0
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Found listing with ID: 117471399
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471399%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Scrape type for 117471399: 2
2025-11-27 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554783?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554643?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bd4bee19-35a9-52eb-a2fc-cf1767839301 with identifier: 117277530
2025-11-27 19:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bd4bee19-35a9-52eb-a2fc-cf1767839301 with identifier: 117277530
2025-11-27 19:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bd4bee19-35a9-52eb-a2fc-cf1767839301 with identifier: 117277530 to the API
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'bd4bee19-35a9-52eb-a2fc-cf1767839301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KY20FRF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117277530',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'NIRO ESTATE',
 'odometer': 70796,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34407,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/589014da-6ae0-4e6c-8d2a-c4bb41f50727_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34981,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/bde5bdce-ec1c-4118-bcbe-f55f8ffc9dad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34847,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3501f17f-b1f9-4a50-8240-601f9e8b9627_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33423,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/a620c806-b0f1-413a-81c3-751a9cc7ac86_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60290,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/8b2765ec-8571-4967-a556-146ad5c5e670_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65460,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/d1f318bc-d2a4-4c36-a590-72e589de9653_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70477,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/60f1c73c-3a94-4b82-a7ce-840983ef9f47_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4bee19-35a9-52eb-a2fc-cf1767839301/bd4bee19-35a9-52eb-a2fc-cf1767839301_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 11438,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY20FRF/2025-11-25/image/3b594d6e-794b-4af1-a4ee-c577ae2c1aff_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seller_name': 'Kinto',
 'title': 'KIA NIRO ESTATE 1.6 GDi PHEV 3 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6 GDi PHEV 3 5dr DCT',
 'vin': None,
 'year': 2020}
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117277530%27 HTTP/1.1" 200 None
2025-11-27 19:05:02 [astonbarclay.gb] INFO: Saving data for 117277530: {'created_time': 1764270302.871667, 'last_price_update_time': 1764270302.871677, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117277530') HTTP/1.1" 204 0
2025-11-27 19:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3fb50>
2025-11-27 19:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLJ70YZS%252F2025-11-21%252Fimage%252Feac08488-fa88-4546-b35d-4682461096f2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/eac08488-fa88-4546-b35d-4682461096f2_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b88ec5df-4962-5363-9255-f5e11fadffe1
2025-11-27 19:05:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b88ec5df-4962-5363-9255-f5e11fadffe1, skipping ID generation
2025-11-27 19:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b88ec5df-4962-5363-9255-f5e11fadffe1 with scrape type 1
2025-11-27 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b88ec5df-4962-5363-9255-f5e11fadffe1 from tracking dictionaries
2025-11-27 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b88ec5df-4962-5363-9255-f5e11fadffe1 sending to next pipeline
2025-11-27 19:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b88ec5df-4962-5363-9255-f5e11fadffe1, identifier: 117402830
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d1e3d50>
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b88ec5df-4962-5363-9255-f5e11fadffe1 with identifier: 117402830
2025-11-27 19:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b88ec5df-4962-5363-9255-f5e11fadffe1 with identifier: 117402830
2025-11-27 19:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 120356 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    120356
2025-11-27 19:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: b88ec5df-4962-5363-9255-f5e11fadffe1 spider: astonbarclay.gb
2025-11-27 19:05:03 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b88ec5df-4962-5363-9255-f5e11fadffe1 due to rule: high_mileage_for_make.json, error: 120356 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    120356
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'b88ec5df-4962-5363-9255-f5e11fadffe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LJ70YZS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117402830',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 74786,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23533,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/cdb20486-d728-4b0d-aa6d-7ff2c9810cde_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26117,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/5054086b-1012-4f31-bb6c-28753fb497eb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27267,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/eac08488-fa88-4546-b35d-4682461096f2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23612,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/88de37ba-8063-4916-97d2-830491c22251_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34857,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/531c0a20-2379-4c27-be8e-cb5e022f5a7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42124,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/3327aa6b-9307-4cb0-a14c-fe8b07a5fb6b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49454,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/bcc88591-c0dd-4b41-bde1-1ff35555b74e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b88ec5df-4962-5363-9255-f5e11fadffe1/b88ec5df-4962-5363-9255-f5e11fadffe1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44170,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LJ70YZS/2025-11-21/image/34188bc0-d53d-4dc4-b2e6-811f2ba4d5d7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seller_name': 'Kinto',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2020}
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402830%27 HTTP/1.1" 200 None
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Saving data for 117402830: {'created_time': 1764270303.855296, 'last_price_update_time': 1764270303.855304, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117402830') HTTP/1.1" 204 0
2025-11-27 19:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YP72WBE/2025-11-19/image/9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117101358?view=catalogue)
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Found listing with ID: 117543807
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543807%27 HTTP/1.1" 200 None
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Scrape type for 117543807: 0
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Found listing with ID: 117550254
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550254%27 HTTP/1.1" 200 None
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Scrape type for 117550254: 0
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Found listing with ID: 117543749
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543749%27 HTTP/1.1" 200 None
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Scrape type for 117543749: 0
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Found listing with ID: 116557093
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116557093%27 HTTP/1.1" 200 None
2025-11-27 19:05:03 [astonbarclay.gb] INFO: Scrape type for 116557093: 1
2025-11-27 19:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554799?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554620?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea1db50>
2025-11-27 19:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FND21ECZ%252F2025-11-19%252Fimage%252F6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e37daea7-64c2-52b2-a586-c4295913a1b6
2025-11-27 19:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e37daea7-64c2-52b2-a586-c4295913a1b6, skipping ID generation
2025-11-27 19:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37daea7-64c2-52b2-a586-c4295913a1b6 with scrape type 1
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e37daea7-64c2-52b2-a586-c4295913a1b6 from tracking dictionaries
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e37daea7-64c2-52b2-a586-c4295913a1b6 sending to next pipeline
2025-11-27 19:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e37daea7-64c2-52b2-a586-c4295913a1b6, identifier: 117099210
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e99f350>
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM72EJJ%252F2025-11-14%252Fimage%252F0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a41ae796-efd0-5c70-b725-bddc08ebb3fd
2025-11-27 19:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a41ae796-efd0-5c70-b725-bddc08ebb3fd, skipping ID generation
2025-11-27 19:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41ae796-efd0-5c70-b725-bddc08ebb3fd with scrape type 1
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a41ae796-efd0-5c70-b725-bddc08ebb3fd from tracking dictionaries
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a41ae796-efd0-5c70-b725-bddc08ebb3fd sending to next pipeline
2025-11-27 19:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a41ae796-efd0-5c70-b725-bddc08ebb3fd, identifier: 117209040
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd0c0d0>
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252Fd25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/d25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9b9390>
2025-11-27 19:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d411910>
2025-11-27 19:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAF71YCM%252F2025-11-18%252Fimage%252Fce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94218730-f333-5cb1-bc52-8c3e9c5a1407
2025-11-27 19:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94218730-f333-5cb1-bc52-8c3e9c5a1407, skipping ID generation
2025-11-27 19:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94218730-f333-5cb1-bc52-8c3e9c5a1407 with scrape type 1
2025-11-27 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 94218730-f333-5cb1-bc52-8c3e9c5a1407 from tracking dictionaries
2025-11-27 19:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94218730-f333-5cb1-bc52-8c3e9c5a1407 sending to next pipeline
2025-11-27 19:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 94218730-f333-5cb1-bc52-8c3e9c5a1407, identifier: 117242484
2025-11-27 19:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WK25HGE/2025-11-20/image/c6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116666877?view=catalogue)
2025-11-27 19:05:05 [scrapy.extensions.logstats] INFO: Crawled 252 pages (at 28 pages/min), scraped 170 items (at 13 items/min)
2025-11-27 19:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e37daea7-64c2-52b2-a586-c4295913a1b6 with identifier: 117099210
2025-11-27 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e37daea7-64c2-52b2-a586-c4295913a1b6 with identifier: 117099210
2025-11-27 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'kia e-niro electric estate 150kw 4+ 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'e-niro electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 38504, 'odometer_reading_unit': 'mi', 'registration_date': '2021-06-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099210', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 4+ 64kwh 5dr auto', 'license_plate': 'nd21ecz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e37daea7-64c2-52b2-a586-c4295913a1b6', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33717}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33811}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33959}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 61832}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59499}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 61786}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63509}], 'current_year_diff': 4, 'age_in_months': 53, 'make_model': 'kia e-niro electric estate', 'sanitized_make': 'kia', 'odometer_in_km': 61966} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'e37daea7-64c2-52b2-a586-c4295913a1b6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nd21ecz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099210',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'kia',
     'make_model': 'kia e-niro electric estate',
     'model': 'e-niro electric estate',
     'odometer': 38504,
     'odometer_in_km': 61966,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33717,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33425,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33811,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33959,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61832,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59499,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61786,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63509,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-06-10',
     'sanitized_make': 'kia',
     'seller_name': 'kinto',
     'title': 'kia e-niro electric estate 150kw 4+ 64kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 4+ 64kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-11-27 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: e37daea7-64c2-52b2-a586-c4295913a1b6 spider: astonbarclay.gb
2025-11-27 19:05:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: e37daea7-64c2-52b2-a586-c4295913a1b6 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'kia e-niro electric estate 150kw 4+ 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'e-niro electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 38504, 'odometer_reading_unit': 'mi', 'registration_date': '2021-06-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099210', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '150kw 4+ 64kwh 5dr auto', 'license_plate': 'nd21ecz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'e37daea7-64c2-52b2-a586-c4295913a1b6', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33717}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33811}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33959}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 61832}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59499}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 61786}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63509}], 'current_year_diff': 4, 'age_in_months': 53, 'make_model': 'kia e-niro electric estate', 'sanitized_make': 'kia', 'odometer_in_km': 61966} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'e37daea7-64c2-52b2-a586-c4295913a1b6',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nd21ecz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099210',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'kia',
     'make_model': 'kia e-niro electric estate',
     'model': 'e-niro electric estate',
     'odometer': 38504,
     'odometer_in_km': 61966,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33717,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33425,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33811,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33959,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61832,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59499,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 61786,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63509,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-06-10',
     'sanitized_make': 'kia',
     'seller_name': 'kinto',
     'title': 'kia e-niro electric estate 150kw 4+ 64kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw 4+ 64kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'e37daea7-64c2-52b2-a586-c4295913a1b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ND21ECZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099210',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'E-NIRO ELECTRIC ESTATE',
 'odometer': 38504,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33717,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6f1fe63d-6d86-4648-b385-6fb8ab10e934_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33425,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/02f5ed24-6add-4c55-9688-1598db12933e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33811,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/4e0c94de-e9db-44d2-97c2-a29508f53723_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33959,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/caf69298-cdde-44a3-a48d-e0bd9c2f0826_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/f30026d0-ef44-4074-8ae2-680c684721a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59499,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/0eb76715-9505-41a1-9428-5d1fc5ea6742_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61786,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/6ec39ec1-ce01-4f27-a859-0033745bb8fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37daea7-64c2-52b2-a586-c4295913a1b6/e37daea7-64c2-52b2-a586-c4295913a1b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63509,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ND21ECZ/2025-11-19/image/96042f78-f774-4bdd-bd04-70a70d0813c7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-10',
 'seller_name': 'Kinto',
 'title': 'KIA E-NIRO ELECTRIC ESTATE 150kW 4+ 64kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW 4+ 64kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099210%27 HTTP/1.1" 200 None
2025-11-27 19:05:05 [astonbarclay.gb] INFO: Saving data for 117099210: {'created_time': 1764270305.685402, 'last_price_update_time': 1764270305.68541, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099210') HTTP/1.1" 204 0
2025-11-27 19:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a41ae796-efd0-5c70-b725-bddc08ebb3fd with identifier: 117209040
2025-11-27 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a41ae796-efd0-5c70-b725-bddc08ebb3fd with identifier: 117209040
2025-11-27 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'hyundai ioniq 5 electric hatchback 125kw premium 58 kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq 5 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 52656, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-04', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209040', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '125kw premium 58 kwh 5dr auto', 'license_plate': 'km72ejj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a41ae796-efd0-5c70-b725-bddc08ebb3fd', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28323}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31291}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45398}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56394}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47665}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'hyundai ioniq 5 electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 84741} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'a41ae796-efd0-5c70-b725-bddc08ebb3fd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'km72ejj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209040',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq 5 electric hatchback',
     'model': 'ioniq 5 electric hatchback',
     'odometer': 52656,
     'odometer_in_km': 84741,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28754,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28323,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32584,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31291,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39119,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45398,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56394,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47665,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-04',
     'sanitized_make': 'hyundai',
     'seller_name': 'kinto',
     'title': 'hyundai ioniq 5 electric hatchback 125kw premium 58 kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '125kw premium 58 kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: a41ae796-efd0-5c70-b725-bddc08ebb3fd spider: astonbarclay.gb
2025-11-27 19:05:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a41ae796-efd0-5c70-b725-bddc08ebb3fd due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'hyundai ioniq 5 electric hatchback 125kw premium 58 kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq 5 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 52656, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-04', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209040', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '125kw premium 58 kwh 5dr auto', 'license_plate': 'km72ejj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a41ae796-efd0-5c70-b725-bddc08ebb3fd', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 28323}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31291}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45398}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56394}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47665}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'hyundai ioniq 5 electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 84741} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'a41ae796-efd0-5c70-b725-bddc08ebb3fd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'km72ejj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209040',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq 5 electric hatchback',
     'model': 'ioniq 5 electric hatchback',
     'odometer': 52656,
     'odometer_in_km': 84741,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28754,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28323,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32584,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31291,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39119,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45398,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56394,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47665,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-04',
     'sanitized_make': 'hyundai',
     'seller_name': 'kinto',
     'title': 'hyundai ioniq 5 electric hatchback 125kw premium 58 kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '125kw premium 58 kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'a41ae796-efd0-5c70-b725-bddc08ebb3fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KM72EJJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209040',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'HYUNDAI',
 'model': 'IONIQ 5 ELECTRIC HATCHBACK',
 'odometer': 52656,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28754,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28323,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32584,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31291,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39119,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45398,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56394,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41ae796-efd0-5c70-b725-bddc08ebb3fd/a41ae796-efd0-5c70-b725-bddc08ebb3fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47665,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-04',
 'seller_name': 'Kinto',
 'title': 'HYUNDAI IONIQ 5 ELECTRIC HATCHBACK 125kW Premium 58 kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '125kW Premium 58 kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209040%27 HTTP/1.1" 200 None
2025-11-27 19:05:05 [astonbarclay.gb] INFO: Saving data for 117209040: {'created_time': 1764270305.952535, 'last_price_update_time': 1764270305.952548, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117209040') HTTP/1.1" 204 0
2025-11-27 19:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 94218730-f333-5cb1-bc52-8c3e9c5a1407 with identifier: 117242484
2025-11-27 19:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 94218730-f333-5cb1-bc52-8c3e9c5a1407 with identifier: 117242484
2025-11-27 19:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw active premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 36272, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242484', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw active premium 50kwh 5dr auto', 'license_plate': 'af71ycm', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '94218730-f333-5cb1-bc52-8c3e9c5a1407', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39945}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41189}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36232}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36607}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52612}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 66089}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 67687}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 69312}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 58373} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'orange',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '94218730-f333-5cb1-bc52-8c3e9c5a1407',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'af71ycm',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242484',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'peugeot',
     'make_model': 'peugeot e-2008 electric estate',
     'model': 'e-2008 electric estate',
     'odometer': 36272,
     'odometer_in_km': 58373,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39945,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41189,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36232,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36607,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52612,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66089,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67687,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69312,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-05',
     'sanitized_make': 'peugeot',
     'seller_name': 'kinto',
     'title': 'peugeot e-2008 electric estate 100kw active premium 50kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '100kw active premium 50kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-11-27 19:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 94218730-f333-5cb1-bc52-8c3e9c5a1407 spider: astonbarclay.gb
2025-11-27 19:05:06 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 94218730-f333-5cb1-bc52-8c3e9c5a1407 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'peugeot e-2008 electric estate 100kw active premium 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-2008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 36272, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242484', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw active premium 50kwh 5dr auto', 'license_plate': 'af71ycm', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '94218730-f333-5cb1-bc52-8c3e9c5a1407', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39945}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41189}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36232}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36607}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52612}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 66089}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 67687}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 69312}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'peugeot e-2008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 58373} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'orange',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '94218730-f333-5cb1-bc52-8c3e9c5a1407',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'af71ycm',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242484',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'peugeot',
     'make_model': 'peugeot e-2008 electric estate',
     'model': 'e-2008 electric estate',
     'odometer': 36272,
     'odometer_in_km': 58373,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39945,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41189,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36232,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36607,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52612,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66089,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67687,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 69312,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-05',
     'sanitized_make': 'peugeot',
     'seller_name': 'kinto',
     'title': 'peugeot e-2008 electric estate 100kw active premium 50kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '100kw active premium 50kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '94218730-f333-5cb1-bc52-8c3e9c5a1407',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AF71YCM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242484',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'PEUGEOT',
 'model': 'E-2008 ELECTRIC ESTATE',
 'odometer': 36272,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39945,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ae415117-9c6a-47dd-ace2-b0e12359878a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41189,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/f0254274-cc89-4e99-af98-7514144342c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36232,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/4b49ef13-88fb-4db1-aad5-bf67d4a14eb6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36607,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce507ef7-42e6-470c-8586-f4c94757badf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52612,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/b4a1eaa2-dce9-4c7e-b5aa-093bf0f88ff7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66089,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/58c733a6-8a99-4264-b452-fb4c84a2ca35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67687,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/a0cb7fa9-7fb1-4491-baf7-763d2e4f38ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94218730-f333-5cb1-bc52-8c3e9c5a1407/94218730-f333-5cb1-bc52-8c3e9c5a1407_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69312,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AF71YCM/2025-11-18/image/ce50b275-dda4-455b-9b54-c5d7552dfc5e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-05',
 'seller_name': 'Kinto',
 'title': 'PEUGEOT E-2008 ELECTRIC ESTATE 100kW Active Premium 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Active Premium 50kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242484%27 HTTP/1.1" 200 None
2025-11-27 19:05:06 [astonbarclay.gb] INFO: Saving data for 117242484: {'created_time': 1764270306.197415, 'last_price_update_time': 1764270306.197424, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117242484') HTTP/1.1" 204 0
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e937910>
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fcac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/cac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eceac50>
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:05:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554783, 'registration': 'SB17ZHJ', 'account': 'ARN074', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Blue Drive SE 5dr 2WD', 'mileage': 87509, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-05-11', 'fuel': 'Petrol', 'motExpiry': '2026-01-20', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 36k, 43k, 44k, 56k, 68k, 79k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554783, 'registration': 'SB17ZHJ', 'account': 'ARN074', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6 GDi Blue Drive SE 5dr 2WD', 'mileage': 87509, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-05-11', 'fuel': 'Petrol', 'motExpiry': '2026-01-20', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 36k, 43k, 44k, 56k, 68k, 79k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b5f01d-4091-5a79-913b-574a94e0f2bc with identifier: 117554783
2025-11-27 19:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b5f01d-4091-5a79-913b-574a94e0f2bc with scrape type 1
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 57b5f01d-4091-5a79-913b-574a94e0f2bc
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 57b5f01d-4091-5a79-913b-574a94e0f2bc
2025-11-27 19:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 57b5f01d-4091-5a79-913b-574a94e0f2bc, identifier: 117554783
2025-11-27 19:05:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554643, 'registration': 'NL69OLG', 'account': 'ARN224', 'make': 'SEAT', 'model': 'IBIZA HATCHBACK', 'derivative': '1.0 FR [EZ] 5dr', 'mileage': 64472, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2025-11-26', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 34k, 43k, 54k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554643, 'registration': 'NL69OLG', 'account': 'ARN224', 'make': 'SEAT', 'model': 'IBIZA HATCHBACK', 'derivative': '1.0 FR [EZ] 5dr', 'mileage': 64472, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2025-11-26', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 34k, 43k, 54k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6173433-da1b-5f72-bd87-c390ada15c02 with identifier: 117554643
2025-11-27 19:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6173433-da1b-5f72-bd87-c390ada15c02 with scrape type 1
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e6173433-da1b-5f72-bd87-c390ada15c02
2025-11-27 19:05:06 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e6173433-da1b-5f72-bd87-c390ada15c02
2025-11-27 19:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e6173433-da1b-5f72-bd87-c390ada15c02, identifier: 117554643
2025-11-27 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue)
2025-11-27 19:05:06 [astonbarclay.gb] INFO: Found listing with ID: 117570357
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570357%27 HTTP/1.1" 200 None
2025-11-27 19:05:06 [astonbarclay.gb] INFO: Scrape type for 117570357: 1
2025-11-27 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554834?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 57b5f01d-4091-5a79-913b-574a94e0f2bc with identifier: 117554783
2025-11-27 19:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 57b5f01d-4091-5a79-913b-574a94e0f2bc with identifier: 117554783
2025-11-27 19:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 57b5f01d-4091-5a79-913b-574a94e0f2bc with identifier: 117554783 to the API
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2757b5f01d-4091-5a79-913b-574a94e0f2bc%27 HTTP/1.1" 200 None
2025-11-27 19:05:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 57b5f01d-4091-5a79-913b-574a94e0f2bc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:06 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554783?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '57b5f01d-4091-5a79-913b-574a94e0f2bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SB17ZHJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554783',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 87509,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-11',
 'seller_name': 'Arnold Clark',
 'title': 'HYUNDAI TUCSON ESTATE 1.6 GDi Blue Drive SE 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 GDi Blue Drive SE 5dr 2WD',
 'vin': None,
 'year': 2017}
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554783%27 HTTP/1.1" 200 None
2025-11-27 19:05:07 [astonbarclay.gb] INFO: Saving data for 117554783: {'created_time': 1764270307.223831, 'last_price_update_time': 1764270307.22384, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554783') HTTP/1.1" 204 0
2025-11-27 19:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e6173433-da1b-5f72-bd87-c390ada15c02 with identifier: 117554643
2025-11-27 19:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e6173433-da1b-5f72-bd87-c390ada15c02 with identifier: 117554643
2025-11-27 19:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e6173433-da1b-5f72-bd87-c390ada15c02 with identifier: 117554643 to the API
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e6173433-da1b-5f72-bd87-c390ada15c02%27 HTTP/1.1" 200 None
2025-11-27 19:05:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e6173433-da1b-5f72-bd87-c390ada15c02: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554643?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e6173433-da1b-5f72-bd87-c390ada15c02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL69OLG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554643',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SEAT',
 'model': 'IBIZA HATCHBACK',
 'odometer': 64472,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-25',
 'seller_name': 'Arnold Clark',
 'title': 'SEAT IBIZA HATCHBACK 1.0 FR [EZ] 5dr',
 'transmission': 'manual',
 'trim': '1.0 FR [EZ] 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554643%27 HTTP/1.1" 200 None
2025-11-27 19:05:07 [astonbarclay.gb] INFO: Saving data for 117554643: {'created_time': 1764270307.515405, 'last_price_update_time': 1764270307.515414, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554643') HTTP/1.1" 204 0
2025-11-27 19:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9ea58650>
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117069859?view=catalogue)
2025-11-27 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/a00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9ea4fa90>
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYP72WBE%252F2025-11-19%252Fimage%252F9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YP72WBE/2025-11-19/image/9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b72b25f4-8b49-558e-bf65-eda272383035
2025-11-27 19:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b72b25f4-8b49-558e-bf65-eda272383035, skipping ID generation
2025-11-27 19:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72b25f4-8b49-558e-bf65-eda272383035 with scrape type 1
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b72b25f4-8b49-558e-bf65-eda272383035 from tracking dictionaries
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b72b25f4-8b49-558e-bf65-eda272383035 sending to next pipeline
2025-11-27 19:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b72b25f4-8b49-558e-bf65-eda272383035, identifier: 117101358
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554799, 'registration': 'SC16TWN', 'account': 'ARN143', 'make': 'HONDA', 'model': 'HR-V DIESEL HATCHBACK', 'derivative': '1.6 i-DTEC SE 5dr', 'mileage': 49874, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-31', 'fuel': 'Diesel', 'motExpiry': '2025-11-12', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 19k, 25k, 28k, 31k, 36k, 43k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554799, 'registration': 'SC16TWN', 'account': 'ARN143', 'make': 'HONDA', 'model': 'HR-V DIESEL HATCHBACK', 'derivative': '1.6 i-DTEC SE 5dr', 'mileage': 49874, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-31', 'fuel': 'Diesel', 'motExpiry': '2025-11-12', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 19k, 25k, 28k, 31k, 36k, 43k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2baa443-1203-55c5-a566-5275ddfdc4be with identifier: 117554799
2025-11-27 19:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2baa443-1203-55c5-a566-5275ddfdc4be with scrape type 1
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b2baa443-1203-55c5-a566-5275ddfdc4be
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b2baa443-1203-55c5-a566-5275ddfdc4be
2025-11-27 19:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b2baa443-1203-55c5-a566-5275ddfdc4be, identifier: 117554799
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554620, 'registration': 'SV19HVE', 'account': 'AST025', 'make': 'MAZDA', 'model': 'MX-5 CONVERTIBLE', 'derivative': '1.5 [132] SE-L Nav+ 2dr', 'mileage': 22281, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-17', 'doors': 2, 'engineSize': 1496, 'bodyType': 'Convertible', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 11k, 11k, 17k, 22k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554620, 'registration': 'SV19HVE', 'account': 'AST025', 'make': 'MAZDA', 'model': 'MX-5 CONVERTIBLE', 'derivative': '1.5 [132] SE-L Nav+ 2dr', 'mileage': 22281, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-17', 'doors': 2, 'engineSize': 1496, 'bodyType': 'Convertible', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 11k, 11k, 17k, 22k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d980f99c-31c7-5aa7-8272-44b05cb88141 with identifier: 117554620
2025-11-27 19:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d980f99c-31c7-5aa7-8272-44b05cb88141 with scrape type 1
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d980f99c-31c7-5aa7-8272-44b05cb88141
2025-11-27 19:05:08 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d980f99c-31c7-5aa7-8272-44b05cb88141
2025-11-27 19:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d980f99c-31c7-5aa7-8272-44b05cb88141, identifier: 117554620
2025-11-27 19:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MC23EFM/2025-11-18/image/2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117235504?view=catalogue)
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Found listing with ID: 115302250
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Scrape type for 115302250: 0
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Found listing with ID: 116504950
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116504950%27 HTTP/1.1" 200 None
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Scrape type for 116504950: 1
2025-11-27 19:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b72b25f4-8b49-558e-bf65-eda272383035 with identifier: 117101358
2025-11-27 19:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b72b25f4-8b49-558e-bf65-eda272383035 with identifier: 117101358
2025-11-27 19:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b72b25f4-8b49-558e-bf65-eda272383035 with identifier: 117101358 to the API
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YP72WBE/2025-11-19/image/9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'b72b25f4-8b49-558e-bf65-eda272383035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YP72WBE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117101358',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 39428,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36256,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/795d3d8e-37c1-4859-922a-85fdd67f00f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35314,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/7fdba80e-8b80-41fb-97b2-4563f3d3a4ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33130,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/2f85cdb8-1231-41a1-95d3-4e0d40ae8f12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32611,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/3cbdb51c-b419-48e4-a5d7-d18cd332768c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53799,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/9bed9473-4c89-4a6f-9ea3-b15852b9216c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61614,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/d25ad9b3-f461-4400-902a-07c8401fce7a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68233,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/591344be-47f4-4f01-95e3-70bf215d7aaf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72b25f4-8b49-558e-bf65-eda272383035/b72b25f4-8b49-558e-bf65-eda272383035_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66823,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YP72WBE/2025-11-19/image/4865d3b5-c8a3-464b-b72d-a4e73e6a1816_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seller_name': 'Kinto',
 'title': 'FORD KUGA ESTATE 2.5 PHEV ST-Line Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 PHEV ST-Line Edition 5dr CVT',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101358%27 HTTP/1.1" 200 None
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Saving data for 117101358: {'created_time': 1764270308.691724, 'last_price_update_time': 1764270308.691736, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117101358') HTTP/1.1" 204 0
2025-11-27 19:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b2baa443-1203-55c5-a566-5275ddfdc4be with identifier: 117554799
2025-11-27 19:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b2baa443-1203-55c5-a566-5275ddfdc4be with identifier: 117554799
2025-11-27 19:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b2baa443-1203-55c5-a566-5275ddfdc4be with identifier: 117554799 to the API
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b2baa443-1203-55c5-a566-5275ddfdc4be%27 HTTP/1.1" 200 None
2025-11-27 19:05:08 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b2baa443-1203-55c5-a566-5275ddfdc4be: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:08 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554799?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b2baa443-1203-55c5-a566-5275ddfdc4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SC16TWN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554799',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HONDA',
 'model': 'HR-V DIESEL HATCHBACK',
 'odometer': 49874,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': 'Arnold Clark',
 'title': 'HONDA HR-V DIESEL HATCHBACK 1.6 i-DTEC SE 5dr',
 'transmission': 'manual',
 'trim': '1.6 i-DTEC SE 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554799%27 HTTP/1.1" 200 None
2025-11-27 19:05:08 [astonbarclay.gb] INFO: Saving data for 117554799: {'created_time': 1764270308.985953, 'last_price_update_time': 1764270308.985962, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554799') HTTP/1.1" 204 0
2025-11-27 19:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d980f99c-31c7-5aa7-8272-44b05cb88141 with identifier: 117554620
2025-11-27 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d980f99c-31c7-5aa7-8272-44b05cb88141 with identifier: 117554620
2025-11-27 19:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d980f99c-31c7-5aa7-8272-44b05cb88141 with identifier: 117554620 to the API
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d980f99c-31c7-5aa7-8272-44b05cb88141%27 HTTP/1.1" 200 None
2025-11-27 19:05:09 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d980f99c-31c7-5aa7-8272-44b05cb88141: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:08 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554620?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd980f99c-31c7-5aa7-8272-44b05cb88141',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SV19HVE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554620',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MAZDA',
 'model': 'MX-5 CONVERTIBLE',
 'odometer': 22281,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': 'Arnold Clark',
 'title': 'MAZDA MX-5 CONVERTIBLE 1.5 [132] SE-L Nav+ 2dr',
 'transmission': 'manual',
 'trim': '1.5 [132] SE-L Nav+ 2dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554620%27 HTTP/1.1" 200 None
2025-11-27 19:05:09 [astonbarclay.gb] INFO: Saving data for 117554620: {'created_time': 1764270309.279192, 'last_price_update_time': 1764270309.279202, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554620') HTTP/1.1" 204 0
2025-11-27 19:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e935b50>
2025-11-27 19:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWK25HGE%252F2025-11-20%252Fimage%252Fc6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WK25HGE/2025-11-20/image/c6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd
2025-11-27 19:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0726d4c-3adb-51e1-808f-9bb0a77a18dd, skipping ID generation
2025-11-27 19:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd with scrape type 1
2025-11-27 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c0726d4c-3adb-51e1-808f-9bb0a77a18dd from tracking dictionaries
2025-11-27 19:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0726d4c-3adb-51e1-808f-9bb0a77a18dd sending to next pipeline
2025-11-27 19:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c0726d4c-3adb-51e1-808f-9bb0a77a18dd, identifier: 116666877
2025-11-27 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/VN72BBX/2025-11-19/image/11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117308707?view=catalogue)
2025-11-27 19:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c0726d4c-3adb-51e1-808f-9bb0a77a18dd with identifier: 116666877
2025-11-27 19:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c0726d4c-3adb-51e1-808f-9bb0a77a18dd with identifier: 116666877
2025-11-27 19:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c0726d4c-3adb-51e1-808f-9bb0a77a18dd with identifier: 116666877 to the API
2025-11-27 19:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/WK25HGE/2025-11-20/image/c6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c0726d4c-3adb-51e1-808f-9bb0a77a18dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WK25HGE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116666877',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'DACIA',
 'model': 'SANDERO HATCHBACK',
 'odometer': 16485,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35136,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/dadf289c-6dfb-41e2-9bc5-1c35445ed4ff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33270,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/8096d9bb-df19-4445-83f9-2211eb64164f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32163,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/a8772e0a-d3c6-4bfd-90e7-46032978aa96_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32241,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/b41f09ba-5a9f-401d-aab9-8035ddb370b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50945,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/0617e872-c583-4c82-be8a-1a13df64bcfc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43912,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/f6ea4078-b6ce-4ad4-9868-f27588e47e00_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50076,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/c6cea3bf-cca9-4ba2-8195-6ed9050a3388_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0726d4c-3adb-51e1-808f-9bb0a77a18dd/c0726d4c-3adb-51e1-808f-9bb0a77a18dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45443,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WK25HGE/2025-11-20/image/cac85f7d-fe25-4b02-8151-c2fbf668b6c7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-04',
 'seller_name': 'Kinto',
 'title': 'DACIA SANDERO HATCHBACK 1.0 Tce Journey 5dr',
 'transmission': 'manual',
 'trim': '1.0 Tce Journey 5dr',
 'vin': None,
 'year': 2025}
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116666877%27 HTTP/1.1" 200 None
2025-11-27 19:05:10 [astonbarclay.gb] INFO: Saving data for 116666877: {'created_time': 1764270310.497525, 'last_price_update_time': 1764270310.497537, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116666877') HTTP/1.1" 204 0
2025-11-27 19:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaea910>
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252Fedb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb6f50>
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb7d50>
2025-11-27 19:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOV71KXJ%252F2025-11-19%252Fimage%252F851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 696f7c52-0072-5b70-95f2-a5ab6ddda589
2025-11-27 19:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 696f7c52-0072-5b70-95f2-a5ab6ddda589, skipping ID generation
2025-11-27 19:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 696f7c52-0072-5b70-95f2-a5ab6ddda589 with scrape type 1
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 696f7c52-0072-5b70-95f2-a5ab6ddda589 from tracking dictionaries
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 696f7c52-0072-5b70-95f2-a5ab6ddda589 sending to next pipeline
2025-11-27 19:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 696f7c52-0072-5b70-95f2-a5ab6ddda589, identifier: 117256307
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554834, 'registration': 'YF21CFJ', 'account': 'ARN080', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr', 'mileage': 17168, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-04-28', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 7k, 14k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554834, 'registration': 'YF21CFJ', 'account': 'ARN080', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr', 'mileage': 17168, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-04-28', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 7k, 14k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d893a545-9c43-50dc-a6e9-00b9c60fb4b9 with identifier: 117554834
2025-11-27 19:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d893a545-9c43-50dc-a6e9-00b9c60fb4b9 with scrape type 1
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d893a545-9c43-50dc-a6e9-00b9c60fb4b9
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d893a545-9c43-50dc-a6e9-00b9c60fb4b9
2025-11-27 19:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d893a545-9c43-50dc-a6e9-00b9c60fb4b9, identifier: 117554834
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117369086, 'registration': 'GY72DFC', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 17931, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-09', 'fuel': 'Electric', 'motExpiry': '2026-11-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/23-6k, 09/24-12k, 09/25-16k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5707cf4c-e330-4008-8b47-5d00fd0949a1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117369086, 'registration': 'GY72DFC', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 17931, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-09', 'fuel': 'Electric', 'motExpiry': '2026-11-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/23-6k, 09/24-12k, 09/25-16k,', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5707cf4c-e330-4008-8b47-5d00fd0949a1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5104a921-562c-5392-ba72-2df013980db0 with identifier: 117369086
2025-11-27 19:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5104a921-562c-5392-ba72-2df013980db0 with scrape type 1
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252Fbe705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117514825?view=catalogue)
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Found listing with ID: 117547683
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547683%27 HTTP/1.1" 200 None
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Scrape type for 117547683: 1
2025-11-27 19:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 696f7c52-0072-5b70-95f2-a5ab6ddda589 with identifier: 117256307
2025-11-27 19:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 696f7c52-0072-5b70-95f2-a5ab6ddda589 with identifier: 117256307
2025-11-27 19:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155352 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155352
2025-11-27 19:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 696f7c52-0072-5b70-95f2-a5ab6ddda589 spider: astonbarclay.gb
2025-11-27 19:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 696f7c52-0072-5b70-95f2-a5ab6ddda589 due to rule: high_mileage_for_country.json, error: 155352 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155352
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '696f7c52-0072-5b70-95f2-a5ab6ddda589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV71KXJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117256307',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'ENYAQ IV ESTATE',
 'odometer': 96532,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35407,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34246,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35342,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34159,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50441,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48076,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72159,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696f7c52-0072-5b70-95f2-a5ab6ddda589/696f7c52-0072-5b70-95f2-a5ab6ddda589_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53521,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seller_name': 'Kinto',
 'title': 'SKODA ENYAQ IV ESTATE 132kW 60 ecoSuite 62kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '132kW 60 ecoSuite 62kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256307%27 HTTP/1.1" 200 None
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Saving data for 117256307: {'created_time': 1764270311.680509, 'last_price_update_time': 1764270311.680517, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117256307') HTTP/1.1" 204 0
2025-11-27 19:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d893a545-9c43-50dc-a6e9-00b9c60fb4b9 with identifier: 117554834
2025-11-27 19:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d893a545-9c43-50dc-a6e9-00b9c60fb4b9 with identifier: 117554834
2025-11-27 19:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d893a545-9c43-50dc-a6e9-00b9c60fb4b9 with identifier: 117554834 to the API
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d893a545-9c43-50dc-a6e9-00b9c60fb4b9%27 HTTP/1.1" 200 None
2025-11-27 19:05:11 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d893a545-9c43-50dc-a6e9-00b9c60fb4b9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:11 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554834?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd893a545-9c43-50dc-a6e9-00b9c60fb4b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YF21CFJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554834',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 17168,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seller_name': 'Arnold Clark',
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.0 DiG-T 114 N-Connecta 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554834%27 HTTP/1.1" 200 None
2025-11-27 19:05:11 [astonbarclay.gb] INFO: Saving data for 117554834: {'created_time': 1764270311.982419, 'last_price_update_time': 1764270311.982428, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554834') HTTP/1.1" 204 0
2025-11-27 19:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe41450>
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFX72PXU%252F2025-11-13%252Fimage%252F66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 414a6ee5-291d-5d14-b2af-24f35cba14fb
2025-11-27 19:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 414a6ee5-291d-5d14-b2af-24f35cba14fb, skipping ID generation
2025-11-27 19:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414a6ee5-291d-5d14-b2af-24f35cba14fb with scrape type 1
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 414a6ee5-291d-5d14-b2af-24f35cba14fb from tracking dictionaries
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 414a6ee5-291d-5d14-b2af-24f35cba14fb sending to next pipeline
2025-11-27 19:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 414a6ee5-291d-5d14-b2af-24f35cba14fb, identifier: 117069859
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb6fb50>
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252Fa00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/a00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:05:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554544, 'registration': 'MJ22ULD', 'account': 'ARN037', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 28466, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-04-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 26k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554544, 'registration': 'MJ22ULD', 'account': 'ARN037', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 28466, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-04-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 26k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce65941-8b64-5858-92ad-87b200f14255 with identifier: 117554544
2025-11-27 19:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce65941-8b64-5858-92ad-87b200f14255 with scrape type 1
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3ce65941-8b64-5858-92ad-87b200f14255
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3ce65941-8b64-5858-92ad-87b200f14255
2025-11-27 19:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3ce65941-8b64-5858-92ad-87b200f14255, identifier: 117554544
2025-11-27 19:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117178728?view=catalogue)
2025-11-27 19:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 414a6ee5-291d-5d14-b2af-24f35cba14fb with identifier: 117069859
2025-11-27 19:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 414a6ee5-291d-5d14-b2af-24f35cba14fb with identifier: 117069859
2025-11-27 19:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line premium plus 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 42317, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117069859', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line premium plus 80kwh 5dr auto', 'license_plate': 'fx72pxu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '414a6ee5-291d-5d14-b2af-24f35cba14fb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32057}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45538}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 68658}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 68102} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '414a6ee5-291d-5d14-b2af-24f35cba14fb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fx72pxu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117069859',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 42317,
     'odometer_in_km': 68102,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33820,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32581,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35433,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32057,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57020,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45538,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53566,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68658,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-24',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line premium '
              'plus 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line premium plus 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 414a6ee5-291d-5d14-b2af-24f35cba14fb spider: astonbarclay.gb
2025-11-27 19:05:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 414a6ee5-291d-5d14-b2af-24f35cba14fb due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line premium plus 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 42317, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117069859', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line premium plus 80kwh 5dr auto', 'license_plate': 'fx72pxu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '414a6ee5-291d-5d14-b2af-24f35cba14fb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32057}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45538}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 68658}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 68102} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '414a6ee5-291d-5d14-b2af-24f35cba14fb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'fx72pxu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117069859',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 42317,
     'odometer_in_km': 68102,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33820,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32581,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35433,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32057,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57020,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45538,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53566,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68658,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-24',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line premium '
              'plus 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line premium plus 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '414a6ee5-291d-5d14-b2af-24f35cba14fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FX72PXU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117069859',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 42317,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33820,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/30cca049-7e31-4717-86c4-32f930a32c00_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32581,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/f334651e-109a-44b7-a165-f883c8427a10_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35433,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/0965e6b9-bcd6-421f-b9d0-fac68b0838e9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32057,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/66d66d1a-59f0-480c-ab07-faa1af5ed8e8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57020,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/59f105e1-2684-4003-9e30-86f3afd0b066_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45538,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/1cccfe1a-0925-4961-9ab4-62fa08bfa076_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53566,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/aa381a43-b729-4fe1-926d-786316054656_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_414a6ee5-291d-5d14-b2af-24f35cba14fb/414a6ee5-291d-5d14-b2af-24f35cba14fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68658,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FX72PXU/2025-11-13/image/b3966b47-2a0a-4587-9331-c33ae9e8ff8d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-24',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line Premium Plus 80kWh '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line Premium Plus 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117069859%27 HTTP/1.1" 200 None
2025-11-27 19:05:12 [astonbarclay.gb] INFO: Saving data for 117069859: {'created_time': 1764270312.875728, 'last_price_update_time': 1764270312.87574, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117069859') HTTP/1.1" 204 0
2025-11-27 19:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3ce65941-8b64-5858-92ad-87b200f14255 with identifier: 117554544
2025-11-27 19:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3ce65941-8b64-5858-92ad-87b200f14255 with identifier: 117554544
2025-11-27 19:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3ce65941-8b64-5858-92ad-87b200f14255 with identifier: 117554544 to the API
2025-11-27 19:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273ce65941-8b64-5858-92ad-87b200f14255%27 HTTP/1.1" 200 None
2025-11-27 19:05:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3ce65941-8b64-5858-92ad-87b200f14255: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '3ce65941-8b64-5858-92ad-87b200f14255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MJ22ULD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554544',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 28466,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seller_name': 'Arnold Clark',
 'title': 'FORD KUGA ESTATE 2.5 FHEV ST-Line X Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 FHEV ST-Line X Edition 5dr CVT',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554544%27 HTTP/1.1" 200 None
2025-11-27 19:05:13 [astonbarclay.gb] INFO: Saving data for 117554544: {'created_time': 1764270313.167349, 'last_price_update_time': 1764270313.167358, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554544') HTTP/1.1" 204 0
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e92ed90>
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMC23EFM%252F2025-11-18%252Fimage%252F2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MC23EFM/2025-11-18/image/2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b82d27e7-821c-59cd-951a-ea49b5e76fce
2025-11-27 19:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b82d27e7-821c-59cd-951a-ea49b5e76fce, skipping ID generation
2025-11-27 19:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82d27e7-821c-59cd-951a-ea49b5e76fce with scrape type 1
2025-11-27 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b82d27e7-821c-59cd-951a-ea49b5e76fce from tracking dictionaries
2025-11-27 19:05:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b82d27e7-821c-59cd-951a-ea49b5e76fce sending to next pipeline
2025-11-27 19:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b82d27e7-821c-59cd-951a-ea49b5e76fce, identifier: 117235504
2025-11-27 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:05:13 [astonbarclay.gb] INFO: Found listing with ID: 116645477
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116645477%27 HTTP/1.1" 200 None
2025-11-27 19:05:13 [astonbarclay.gb] INFO: Scrape type for 116645477: 1
2025-11-27 19:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b82d27e7-821c-59cd-951a-ea49b5e76fce with identifier: 117235504
2025-11-27 19:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b82d27e7-821c-59cd-951a-ea49b5e76fce with identifier: 117235504
2025-11-27 19:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b82d27e7-821c-59cd-951a-ea49b5e76fce with identifier: 117235504 to the API
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MC23EFM/2025-11-18/image/2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'b82d27e7-821c-59cd-951a-ea49b5e76fce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MC23EFM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117235504',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 46488,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36453,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/4291315d-45fa-4f2b-a004-490d2c5f576e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35629,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/92167d65-b5c2-4c9b-ba17-f9bd1132fbfc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32023,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/f7bcfea9-267a-4db8-8752-08f20f1a7f04_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31308,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/d3deacd8-7bbc-466c-a4ce-20d91edec079_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56498,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/06ff7331-3737-4c32-8a6e-b9b6ed77318a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68920,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/2ff22ab0-fd81-40ff-bc16-2826b312c61f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68971,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/a00bf98a-3efa-47b6-8781-e209b3ff828c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d27e7-821c-59cd-951a-ea49b5e76fce/b82d27e7-821c-59cd-951a-ea49b5e76fce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68321,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MC23EFM/2025-11-18/image/14e56e3f-9fc7-44e0-a041-c7321a472f31_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-11',
 'seller_name': 'Kinto',
 'title': 'FORD KUGA ESTATE 2.5 PHEV ST-Line X Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 PHEV ST-Line X Edition 5dr CVT',
 'vin': None,
 'year': 2023}
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117235504%27 HTTP/1.1" 200 None
2025-11-27 19:05:13 [astonbarclay.gb] INFO: Saving data for 117235504: {'created_time': 1764270313.860115, 'last_price_update_time': 1764270313.860125, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117235504') HTTP/1.1" 204 0
2025-11-27 19:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea859d0>
2025-11-27 19:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FVN72BBX%252F2025-11-19%252Fimage%252F11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/VN72BBX/2025-11-19/image/11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48
2025-11-27 19:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a768b5c-1acf-5b22-87a5-fd9d61edba48, skipping ID generation
2025-11-27 19:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48 with scrape type 1
2025-11-27 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a768b5c-1acf-5b22-87a5-fd9d61edba48 from tracking dictionaries
2025-11-27 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a768b5c-1acf-5b22-87a5-fd9d61edba48 sending to next pipeline
2025-11-27 19:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3a768b5c-1acf-5b22-87a5-fd9d61edba48, identifier: 117308707
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d314410>
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252Ffb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252Fd452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3a768b5c-1acf-5b22-87a5-fd9d61edba48 with identifier: 117308707
2025-11-27 19:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3a768b5c-1acf-5b22-87a5-fd9d61edba48 with identifier: 117308707
2025-11-27 19:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3a768b5c-1acf-5b22-87a5-fd9d61edba48 with identifier: 117308707 to the API
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/VN72BBX/2025-11-19/image/11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3a768b5c-1acf-5b22-87a5-fd9d61edba48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VN72BBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117308707',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS ESTATE',
 'odometer': 23949,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32404,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/69edd2d5-d62d-4472-8081-9b2018ee1492_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35806,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/d201fde5-2bc0-46a3-bffd-c1a87f6740be_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30335,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/2a52a1a8-4186-4061-9923-4697d02f3d0b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29118,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/11f2636e-63fa-4cf9-a9d7-8c1d0d85f325_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46377,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/c5e17294-b6c6-46ab-ad18-dfd276754fe4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48602,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/a87d4d72-6c02-401d-aabc-00c41f700fd3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/32546ccd-2ad2-4d08-a754-834528dea699_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a768b5c-1acf-5b22-87a5-fd9d61edba48/3a768b5c-1acf-5b22-87a5-fd9d61edba48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42249,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/VN72BBX/2025-11-19/image/3f7838f5-2621-4401-9dbd-684a05a02c14_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN T-CROSS ESTATE 1.0 TSI 110 SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 110 SE 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117308707%27 HTTP/1.1" 200 None
2025-11-27 19:05:14 [astonbarclay.gb] INFO: Saving data for 117308707: {'created_time': 1764270314.86314, 'last_price_update_time': 1764270314.86315, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117308707') HTTP/1.1" 204 0
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feff690>
2025-11-27 19:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252Fc43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec43e90>
2025-11-27 19:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ22HJX%252F2025-11-27%252Fimage%252F2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 875f4b54-74f2-5b45-9e72-d1456fa71be5
2025-11-27 19:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 875f4b54-74f2-5b45-9e72-d1456fa71be5, skipping ID generation
2025-11-27 19:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875f4b54-74f2-5b45-9e72-d1456fa71be5 with scrape type 1
2025-11-27 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 875f4b54-74f2-5b45-9e72-d1456fa71be5 from tracking dictionaries
2025-11-27 19:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 875f4b54-74f2-5b45-9e72-d1456fa71be5 sending to next pipeline
2025-11-27 19:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 875f4b54-74f2-5b45-9e72-d1456fa71be5, identifier: 117514825
2025-11-27 19:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue)
2025-11-27 19:05:15 [astonbarclay.gb] INFO: Found listing with ID: 114344014
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114344014%27 HTTP/1.1" 200 None
2025-11-27 19:05:15 [astonbarclay.gb] INFO: Scrape type for 114344014: 1
2025-11-27 19:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 875f4b54-74f2-5b45-9e72-d1456fa71be5 with identifier: 117514825
2025-11-27 19:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 875f4b54-74f2-5b45-9e72-d1456fa71be5 with identifier: 117514825
2025-11-27 19:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 875f4b54-74f2-5b45-9e72-d1456fa71be5 with identifier: 117514825 to the API
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '875f4b54-74f2-5b45-9e72-d1456fa71be5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ22HJX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117514825',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 28377,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32182,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/4860f38b-a41d-45fd-8bbf-a9e94389b3c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29160,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/5ea22416-c038-4acd-9d8a-523447b93174_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29856,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/c64e07e5-64a7-40be-a4d5-3ee95dba969e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31919,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/39ef618d-e5aa-44e3-817d-b34bfc237fc1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40749,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/3c21defb-b562-45a9-8f68-6fbda63a2326_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66505,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/de20f54f-f237-4d28-89e7-e82e4e4237f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42636,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/059497c0-41eb-4555-a73d-21c401943806_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80786,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/2dec3f6b-c52f-4e09-8213-dc63e9241853_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40025,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/83150372-dde4-4f63-828f-862a8cf80398_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_875f4b54-74f2-5b45-9e72-d1456fa71be5/875f4b54-74f2-5b45-9e72-d1456fa71be5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45316,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ22HJX/2025-11-27/image/332231bc-7628-4ee9-b6a8-8571cba23381_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seller_name': 'Gates Group',
 'title': 'FORD PUMA HATCHBACK 1.5 EcoBoost ST 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBoost ST 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514825%27 HTTP/1.1" 200 None
2025-11-27 19:05:16 [astonbarclay.gb] INFO: Saving data for 117514825: {'created_time': 1764270316.061818, 'last_price_update_time': 1764270316.061829, 'auction_closing_time': 1764756000.0}
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117514825') HTTP/1.1" 204 0
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec188d0>
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252Ff8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea471d0>
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252Ff47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fef6090>
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRV23WKU%252F2025-11-13%252Fimage%252F6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b19c841b-07b1-5c88-906d-93070ec020ce
2025-11-27 19:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b19c841b-07b1-5c88-906d-93070ec020ce, skipping ID generation
2025-11-27 19:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c841b-07b1-5c88-906d-93070ec020ce with scrape type 1
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b19c841b-07b1-5c88-906d-93070ec020ce from tracking dictionaries
2025-11-27 19:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b19c841b-07b1-5c88-906d-93070ec020ce sending to next pipeline
2025-11-27 19:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b19c841b-07b1-5c88-906d-93070ec020ce, identifier: 117178728
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98fc90>
2025-11-27 19:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:05:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117402247, 'registration': 'DP69NVX', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.0 TSI 115 Match Edition 5dr', 'mileage': 85188, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-12-18', 'fuel': 'Petrol', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DP69NVX/2025-11-24/image/29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/eef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/21-20K, 12/22-41k, 12/23-59k, 08/24-68k, 06/25-79k,', 'remarks': 'SPARE KEY, vosa states 41k, 59k, 73k,', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c96b96e9-28c0-43fa-bc2b-2db685af1de5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117402247, 'registration': 'DP69NVX', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.0 TSI 115 Match Edition 5dr', 'mileage': 85188, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-12-18', 'fuel': 'Petrol', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DP69NVX/2025-11-24/image/29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/eef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/21-20K, 12/22-41k, 12/23-59k, 08/24-68k, 06/25-79k,', 'remarks': 'SPARE KEY, vosa states 41k, 59k, 73k,', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c96b96e9-28c0-43fa-bc2b-2db685af1de5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346adf39-4e69-5b8b-98d3-9427ca089574 with identifier: 117402247
2025-11-27 19:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346adf39-4e69-5b8b-98d3-9427ca089574 with scrape type 1
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252F29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117058008?view=catalogue)
2025-11-27 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/c26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117262801?view=catalogue)
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252Fc7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b19c841b-07b1-5c88-906d-93070ec020ce with identifier: 117178728
2025-11-27 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b19c841b-07b1-5c88-906d-93070ec020ce with identifier: 117178728
2025-11-27 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33062, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178728', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'license_plate': 'rv23wku', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b19c841b-07b1-5c88-906d-93070ec020ce', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33227}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33094}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32815}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57164}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53869}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 74431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59319}], 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 53207} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b19c841b-07b1-5c88-906d-93070ec020ce',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'rv23wku',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178728',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 33062,
     'odometer_in_km': 53207,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33227,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33094,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32815,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32536,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57164,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53869,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74431,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59319,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-07-18',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-11-27 19:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b19c841b-07b1-5c88-906d-93070ec020ce spider: astonbarclay.gb
2025-11-27 19:05:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b19c841b-07b1-5c88-906d-93070ec020ce due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33062, 'odometer_reading_unit': 'mi', 'registration_date': '2023-07-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178728', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'license_plate': 'rv23wku', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b19c841b-07b1-5c88-906d-93070ec020ce', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33227}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33094}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32815}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32536}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57164}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53869}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 74431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59319}], 'current_year_diff': 2, 'age_in_months': 28, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 53207} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 28,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b19c841b-07b1-5c88-906d-93070ec020ce',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'rv23wku',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178728',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 33062,
     'odometer_in_km': 53207,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33227,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33094,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32815,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32536,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57164,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53869,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74431,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59319,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-07-18',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'b19c841b-07b1-5c88-906d-93070ec020ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RV23WKU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178728',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQA HATCHBACK',
 'odometer': 33062,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33227,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/66e5ccf4-90a4-43af-97eb-c6636b67daae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33094,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/70abaaea-e9b1-4498-be9d-d80fa78fe3d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32815,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/26106796-58b4-493f-aeef-55af9bae08d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32536,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/ae9669a6-018f-4c9c-9aba-30ec5cdd5120_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57164,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/f47a75c5-6e26-4bce-9ff0-5f79375821f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53869,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/6fdd51d6-1603-4507-a7c3-4cc70a6f2e15_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74431,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/331c1b64-dd6d-4388-8b8e-b99392db1bca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19c841b-07b1-5c88-906d-93070ec020ce/b19c841b-07b1-5c88-906d-93070ec020ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59319,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RV23WKU/2025-11-13/image/fb72576a-f249-445f-9350-879ca252f6e9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-18',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQA HATCHBACK EQA 250+ 140kW AMG Line 70.5kWh 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'EQA 250+ 140kW AMG Line 70.5kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178728%27 HTTP/1.1" 200 None
2025-11-27 19:05:17 [astonbarclay.gb] INFO: Saving data for 117178728: {'created_time': 1764270317.383901, 'last_price_update_time': 1764270317.383909, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117178728') HTTP/1.1" 204 0
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe94fd0>
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F441c359c-b89d-468a-b444-432c4329164d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb6ee10>
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252Ff226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117085521?view=catalogue)
2025-11-27 19:05:17 [astonbarclay.gb] INFO: Found listing with ID: 116500039
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116500039%27 HTTP/1.1" 200 None
2025-11-27 19:05:17 [astonbarclay.gb] INFO: Scrape type for 116500039: 1
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fe63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570357?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117120453?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe5bc10>
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGU72VHR%252F2025-11-11%252Fimage%252F5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac040797-1bbe-5a68-a3ef-1b65270586ce
2025-11-27 19:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac040797-1bbe-5a68-a3ef-1b65270586ce, skipping ID generation
2025-11-27 19:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac040797-1bbe-5a68-a3ef-1b65270586ce with scrape type 1
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ac040797-1bbe-5a68-a3ef-1b65270586ce from tracking dictionaries
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac040797-1bbe-5a68-a3ef-1b65270586ce sending to next pipeline
2025-11-27 19:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ac040797-1bbe-5a68-a3ef-1b65270586ce, identifier: 117058987
2025-11-27 19:05:18 [astonbarclay.gb] INFO: Found listing with ID: 117550264
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550264%27 HTTP/1.1" 200 None
2025-11-27 19:05:18 [astonbarclay.gb] INFO: Scrape type for 117550264: 1
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fe5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ac040797-1bbe-5a68-a3ef-1b65270586ce with identifier: 117058987
2025-11-27 19:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ac040797-1bbe-5a68-a3ef-1b65270586ce with identifier: 117058987
2025-11-27 19:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 35708, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058987', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vhr', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ac040797-1bbe-5a68-a3ef-1b65270586ce', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33818}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32819}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33127}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59580}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 68377}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63496}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 57466} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'ac040797-1bbe-5a68-a3ef-1b65270586ce',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72vhr',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058987',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 35708,
     'odometer_in_km': 57466,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34415,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33818,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32819,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33127,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59580,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58599,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68377,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63496,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-08',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ac040797-1bbe-5a68-a3ef-1b65270586ce spider: astonbarclay.gb
2025-11-27 19:05:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ac040797-1bbe-5a68-a3ef-1b65270586ce due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 35708, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058987', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vhr', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ac040797-1bbe-5a68-a3ef-1b65270586ce', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33818}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32819}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33127}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 59580}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 58599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 68377}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63496}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 57466} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': 'ac040797-1bbe-5a68-a3ef-1b65270586ce',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72vhr',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058987',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 35708,
     'odometer_in_km': 57466,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34415,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33818,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32819,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33127,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59580,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 58599,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68377,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63496,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-08',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ac040797-1bbe-5a68-a3ef-1b65270586ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72VHR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058987',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 35708,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34415,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33818,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32819,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33127,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58599,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68377,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac040797-1bbe-5a68-a3ef-1b65270586ce/ac040797-1bbe-5a68-a3ef-1b65270586ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63496,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058987%27 HTTP/1.1" 200 None
2025-11-27 19:05:18 [astonbarclay.gb] INFO: Saving data for 117058987: {'created_time': 1764270318.622615, 'last_price_update_time': 1764270318.622626, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117058987') HTTP/1.1" 204 0
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9ea910>
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252Fbe705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d1c98d0>
2025-11-27 19:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY73WWA%252F2025-11-11%252Fimage%252F1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29a551e8-f00a-5551-8a26-b32f63a407e3
2025-11-27 19:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29a551e8-f00a-5551-8a26-b32f63a407e3, skipping ID generation
2025-11-27 19:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a551e8-f00a-5551-8a26-b32f63a407e3 with scrape type 1
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 29a551e8-f00a-5551-8a26-b32f63a407e3 from tracking dictionaries
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29a551e8-f00a-5551-8a26-b32f63a407e3 sending to next pipeline
2025-11-27 19:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 29a551e8-f00a-5551-8a26-b32f63a407e3, identifier: 117058008
2025-11-27 19:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb11510>
2025-11-27 19:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFV71VZZ%252F2025-11-25%252Fimage%252Fc26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/c26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3
2025-11-27 19:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e6b2116-8263-57bd-8298-e6f4075b7ad3, skipping ID generation
2025-11-27 19:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3 with scrape type 1
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6e6b2116-8263-57bd-8298-e6f4075b7ad3 from tracking dictionaries
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e6b2116-8263-57bd-8298-e6f4075b7ad3 sending to next pipeline
2025-11-27 19:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6e6b2116-8263-57bd-8298-e6f4075b7ad3, identifier: 117262801
2025-11-27 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 29a551e8-f00a-5551-8a26-b32f63a407e3 with identifier: 117058008
2025-11-27 19:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 29a551e8-f00a-5551-8a26-b32f63a407e3 with identifier: 117058008
2025-11-27 19:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 19560, 'odometer_reading_unit': 'mi', 'registration_date': '2023-11-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058008', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqa 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'license_plate': 'gy73wwa', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '29a551e8-f00a-5551-8a26-b32f63a407e3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51959}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62095}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 66723}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63338}], 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 31478} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '29a551e8-f00a-5551-8a26-b32f63a407e3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gy73wwa',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058008',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 19560,
     'odometer_in_km': 31478,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35561,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34590,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33141,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33755,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51959,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62095,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66723,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63338,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-11-07',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqa hatchback eqa 350 4m 215kw amg line '
              'premium 66.5kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 350 4m 215kw amg line premium 66.5kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-11-27 19:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 29a551e8-f00a-5551-8a26-b32f63a407e3 spider: astonbarclay.gb
2025-11-27 19:05:19 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 29a551e8-f00a-5551-8a26-b32f63a407e3 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 19560, 'odometer_reading_unit': 'mi', 'registration_date': '2023-11-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058008', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqa 350 4m 215kw amg line premium 66.5kwh 5dr auto', 'license_plate': 'gy73wwa', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '29a551e8-f00a-5551-8a26-b32f63a407e3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51959}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62095}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 66723}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 63338}], 'current_year_diff': 2, 'age_in_months': 24, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 31478} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 24,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '29a551e8-f00a-5551-8a26-b32f63a407e3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gy73wwa',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058008',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 19560,
     'odometer_in_km': 31478,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35561,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34590,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33141,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33755,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51959,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62095,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66723,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63338,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-11-07',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqa hatchback eqa 350 4m 215kw amg line '
              'premium 66.5kwh 5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 350 4m 215kw amg line premium 66.5kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '29a551e8-f00a-5551-8a26-b32f63a407e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GY73WWA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058008',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQA HATCHBACK',
 'odometer': 19560,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35561,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/393dc913-cc76-4b17-a2a3-044ea488a8ad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34590,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/48aa0b74-0006-428e-9cc9-34bbfe015276_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33141,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/774f6148-7388-4d78-bb1e-54233f5c2ab1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33755,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/1c28bbb2-ec31-4dbd-8174-8772bce24efa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51959,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/9d924bf4-ded4-47ea-ba36-4afeb433087b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62095,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/cfcdaa42-7598-4a5e-8e85-26d3f25453c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66723,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/85402a42-e963-4c6e-a99c-bf5a86048cff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a551e8-f00a-5551-8a26-b32f63a407e3/29a551e8-f00a-5551-8a26-b32f63a407e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63338,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY73WWA/2025-11-11/image/f226243a-2d69-4ac0-8539-a92e4b712f1f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-07',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQA HATCHBACK EQA 350 4M 215kW AMG Line Premium '
          '66.5kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQA 350 4M 215kW AMG Line Premium 66.5kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058008%27 HTTP/1.1" 200 None
2025-11-27 19:05:19 [astonbarclay.gb] INFO: Saving data for 117058008: {'created_time': 1764270319.916668, 'last_price_update_time': 1764270319.916679, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117058008') HTTP/1.1" 204 0
2025-11-27 19:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6e6b2116-8263-57bd-8298-e6f4075b7ad3 with identifier: 117262801
2025-11-27 19:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6e6b2116-8263-57bd-8298-e6f4075b7ad3 with identifier: 117262801
2025-11-27 19:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6e6b2116-8263-57bd-8298-e6f4075b7ad3 with identifier: 117262801 to the API
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/c26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '6e6b2116-8263-57bd-8298-e6f4075b7ad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FV71VZZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117262801',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'NIRO ESTATE',
 'odometer': 45033,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33183,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/152a9ea3-6404-4d7c-bd79-f63e1735003d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31693,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bf06f35f-7fe6-4187-a4cd-5da78e192968_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31285,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/36d3c573-2e49-4d4b-a22b-947309b063c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31479,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/57e01be5-c1e7-4d4f-9f48-c3cff2032c64_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54272,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/6d0babb4-144e-4834-b43e-2a59e0ac5a80_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47551,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/c26608b2-f923-4a9b-a324-882ddb08d127_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60939,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/d3a6ec53-fd61-4da7-a7fc-8ad1800573a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e6b2116-8263-57bd-8298-e6f4075b7ad3/6e6b2116-8263-57bd-8298-e6f4075b7ad3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54125,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FV71VZZ/2025-11-25/image/bbc8489e-e93a-4624-9054-9a2e88c8ee5b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seller_name': 'Kinto',
 'title': 'KIA NIRO ESTATE 1.6 GDi PHEV 2 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.6 GDi PHEV 2 5dr DCT',
 'vin': None,
 'year': 2021}
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117262801%27 HTTP/1.1" 200 None
2025-11-27 19:05:20 [astonbarclay.gb] INFO: Saving data for 117262801: {'created_time': 1764270320.297454, 'last_price_update_time': 1764270320.297465, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117262801') HTTP/1.1" 204 0
2025-11-27 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:20 [astonbarclay.gb] INFO: Found listing with ID: 117552056
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552056%27 HTTP/1.1" 200 None
2025-11-27 19:05:20 [astonbarclay.gb] INFO: Scrape type for 117552056: 1
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fa7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547683?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe56a10>
2025-11-27 19:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBG72YRJ%252F2025-11-11%252Fimage%252F22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 922a3ca1-0b8d-5bcb-99be-622117efac00
2025-11-27 19:05:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 922a3ca1-0b8d-5bcb-99be-622117efac00, skipping ID generation
2025-11-27 19:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922a3ca1-0b8d-5bcb-99be-622117efac00 with scrape type 1
2025-11-27 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 922a3ca1-0b8d-5bcb-99be-622117efac00 from tracking dictionaries
2025-11-27 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 922a3ca1-0b8d-5bcb-99be-622117efac00 sending to next pipeline
2025-11-27 19:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 922a3ca1-0b8d-5bcb-99be-622117efac00, identifier: 117085521
2025-11-27 19:05:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570357, 'registration': 'LN24CGX', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 23955, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/24349b65-4fb2-4956-b86a-eebcbc74d841.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570357, 'registration': 'LN24CGX', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 23955, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/24349b65-4fb2-4956-b86a-eebcbc74d841.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357
2025-11-27 19:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faad0b89-828d-5df3-a520-dd47d4db81aa with scrape type 1
2025-11-27 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item faad0b89-828d-5df3-a520-dd47d4db81aa
2025-11-27 19:05:20 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item faad0b89-828d-5df3-a520-dd47d4db81aa
2025-11-27 19:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: faad0b89-828d-5df3-a520-dd47d4db81aa, identifier: 117570357
2025-11-27 19:05:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117120453, 'registration': 'ST72AZA', 'account': 'KIN032', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr', 'mileage': 28910, 'mileageWarranty': True, 'type': 'car', 'saleId': 17899, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ST72AZA/2025-11-11/image/90a1b555-26a7-4586-ae85-dca9f8f09744_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/c2d05b4f-c61a-46e8-8b5c-adfd83907e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/b3034557-0247-4ca3-a69e-10a2c4330e1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4e947590-7e03-4fac-bf0c-c809fe48caeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/082844e6-e739-4d26-934f-6ba40c0f93f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/a2623dbc-84c4-4ae3-bec8-40c7d5f2cde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7f4e54e4-f19a-475c-8474-b89e8528682e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4286dcdf-0079-4839-bf4d-2cc6e8b4e170_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7345b254-3cd0-4b86-804e-cce65c31f31c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 - 18K', 'remarks': '**340** VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c01d5c12-8487-41d6-9f51-07b38b637e49.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117120453, 'registration': 'ST72AZA', 'account': 'KIN032', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr', 'mileage': 28910, 'mileageWarranty': True, 'type': 'car', 'saleId': 17899, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ST72AZA/2025-11-11/image/90a1b555-26a7-4586-ae85-dca9f8f09744_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/c2d05b4f-c61a-46e8-8b5c-adfd83907e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/b3034557-0247-4ca3-a69e-10a2c4330e1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4e947590-7e03-4fac-bf0c-c809fe48caeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/082844e6-e739-4d26-934f-6ba40c0f93f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/a2623dbc-84c4-4ae3-bec8-40c7d5f2cde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7f4e54e4-f19a-475c-8474-b89e8528682e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4286dcdf-0079-4839-bf4d-2cc6e8b4e170_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7345b254-3cd0-4b86-804e-cce65c31f31c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 - 18K', 'remarks': '**340** VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c01d5c12-8487-41d6-9f51-07b38b637e49.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453
2025-11-27 19:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3530c1-d232-51cb-a7a1-5bd70c78e942 with scrape type 2
2025-11-27 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb3530c1-d232-51cb-a7a1-5bd70c78e942 with scrape type 2
2025-11-27 19:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cb3530c1-d232-51cb-a7a1-5bd70c78e942, identifier: 117120453
2025-11-27 19:05:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117099256, 'registration': 'MJ21HCG', 'account': 'KIN032', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 45366, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-30', 'fuel': 'Electric', 'motExpiry': '2026-03-29', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/730eddc6-8da6-448d-b421-e49f85f81fa4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117099256, 'registration': 'MJ21HCG', 'account': 'KIN032', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 45366, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-03-30', 'fuel': 'Electric', 'motExpiry': '2026-03-29', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/730eddc6-8da6-448d-b421-e49f85f81fa4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44818002-d623-5739-bbbb-81e35c31515d with identifier: 117099256
2025-11-27 19:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44818002-d623-5739-bbbb-81e35c31515d with scrape type 1
2025-11-27 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3d246d9c-26bb-4de7-98a9-308695b4e667.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117471399?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116941457?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 922a3ca1-0b8d-5bcb-99be-622117efac00 with identifier: 117085521
2025-11-27 19:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 922a3ca1-0b8d-5bcb-99be-622117efac00 with identifier: 117085521
2025-11-27 19:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 922a3ca1-0b8d-5bcb-99be-622117efac00 with identifier: 117085521 to the API
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '922a3ca1-0b8d-5bcb-99be-622117efac00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BG72YRJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117085521',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'OCTAVIA ESTATE',
 'odometer': 22892,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36806,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/dceac97d-18dc-421c-8fbc-3001d9d819d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35949,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/8321335e-c059-4420-b2a8-23fef77fd25d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37700,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/18a7e06e-5d2a-4093-ac08-553a540cf0ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36912,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/91cee593-e885-4c11-9b48-7c32075ad1d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64566,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/df914b26-0d3c-4e54-8127-f95dc86173e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70266,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/22a50a28-dd98-4d7d-aae8-f1936005a7c3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61764,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/976012fa-a21d-4e6a-a9d0-09157d6889dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922a3ca1-0b8d-5bcb-99be-622117efac00/922a3ca1-0b8d-5bcb-99be-622117efac00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71280,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BG72YRJ/2025-11-11/image/029d3970-45c0-4560-b149-610a718e63f5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-11',
 'seller_name': 'Kinto',
 'title': 'SKODA OCTAVIA ESTATE 1.0 TSI SE Technology 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI SE Technology 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085521%27 HTTP/1.1" 200 None
2025-11-27 19:05:21 [astonbarclay.gb] INFO: Saving data for 117085521: {'created_time': 1764270321.525917, 'last_price_update_time': 1764270321.525928, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117085521') HTTP/1.1" 204 0
2025-11-27 19:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357
2025-11-27 19:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357
2025-11-27 19:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357 to the API
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27faad0b89-828d-5df3-a520-dd47d4db81aa%27 HTTP/1.1" 200 None
2025-11-27 19:05:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id faad0b89-828d-5df3-a520-dd47d4db81aa: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117570357?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 19,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'faad0b89-828d-5df3-a520-dd47d4db81aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LN24CGX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570357',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 23955,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-30',
 'seller_name': 'Motability Operations',
 'title': 'HONDA CR-V ESTATE 2.0 ePHEV Advance Tech 5dr eCVT',
 'transmission': 'automatic',
 'trim': '2.0 ePHEV Advance Tech 5dr eCVT',
 'vin': None,
 'year': 2024}
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570357%27 HTTP/1.1" 200 None
2025-11-27 19:05:21 [astonbarclay.gb] INFO: Saving data for 117570357: {'created_time': 1764270321.815809, 'last_price_update_time': 1764270321.81582, 'auction_closing_time': 1765792800.0}
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570357') HTTP/1.1" 204 0
2025-11-27 19:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453
2025-11-27 19:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453
2025-11-27 19:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453 to the API
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117120453?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'cb3530c1-d232-51cb-a7a1-5bd70c78e942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ST72AZA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117120453',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 28910,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': 'Kinto',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120453%27 HTTP/1.1" 200 None
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Saving data for 117120453: {'auction_closing_time': 1764927900.0, 'created_time': 1763579014.462269, 'last_price_update_time': 1764270322.08818}
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117120453') HTTP/1.1" 204 0
2025-11-27 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117099421
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099421%27 HTTP/1.1" 200 None
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117099421: 0
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117545869
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545869%27 HTTP/1.1" 200 None
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117545869: 0
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Found listing with ID: 117553434
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553434%27 HTTP/1.1" 200 None
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Scrape type for 117553434: 1
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fa6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e95a750>
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eacf5d0>
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252Fd452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaf7a10>
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252F29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547683, 'registration': 'LS72NPC', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon Tech 5dr CVT', 'mileage': 20716, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-13', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f067f7f-d4aa-4a03-8300-bcd542a809bc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547683, 'registration': 'LS72NPC', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon Tech 5dr CVT', 'mileage': 20716, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-13', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f067f7f-d4aa-4a03-8300-bcd542a809bc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683
2025-11-27 19:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee275063-9db5-5de0-b650-3b0ea696ee7b with scrape type 1
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ee275063-9db5-5de0-b650-3b0ea696ee7b
2025-11-27 19:05:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ee275063-9db5-5de0-b650-3b0ea696ee7b
2025-11-27 19:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ee275063-9db5-5de0-b650-3b0ea696ee7b, identifier: 117547683
2025-11-27 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/14390625-6024-4354-a128-687d753a8a83.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:23 [astonbarclay.gb] INFO: Found listing with ID: 117550696
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550696%27 HTTP/1.1" 200 None
2025-11-27 19:05:23 [astonbarclay.gb] INFO: Scrape type for 117550696: 1
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252F4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683
2025-11-27 19:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683
2025-11-27 19:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683 to the API
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ee275063-9db5-5de0-b650-3b0ea696ee7b%27 HTTP/1.1" 200 None
2025-11-27 19:05:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ee275063-9db5-5de0-b650-3b0ea696ee7b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117547683?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'ee275063-9db5-5de0-b650-3b0ea696ee7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS72NPC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547683',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORT',
 'odometer': 20716,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-13',
 'seller_name': 'Motability Operations',
 'title': 'TOYOTA COROLLA TOURING SPORT 1.8 VVT-i Hybrid Icon Tech 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547683%27 HTTP/1.1" 200 None
2025-11-27 19:05:23 [astonbarclay.gb] INFO: Saving data for 117547683: {'created_time': 1764270323.395868, 'last_price_update_time': 1764270323.395877, 'auction_closing_time': 1765792800.0}
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547683') HTTP/1.1" 204 0
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd1bf10>
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252Fc7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d3f5f10>
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_13.jpg HTTP/1.1" 201 0
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3d246d9c-26bb-4de7-98a9-308695b4e667.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3d246d9c-26bb-4de7-98a9-308695b4e667.jpg?w=600 saved to cache
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:05:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116504950, 'registration': 'EY74TWG', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr', 'mileage': 7520, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7427946-8dc1-43c4-bfdb-c7d214882c60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116504950, 'registration': 'EY74TWG', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr', 'mileage': 7520, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7427946-8dc1-43c4-bfdb-c7d214882c60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950
2025-11-27 19:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with scrape type 1
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117471399, 'registration': 'LV72UBN', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 17386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV72UBN/2025-11-25/image/af08cb06-4a3b-4f1c-afbd-9d3ad87449b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/97e3a558-7456-43ff-8878-990d8a591c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/2982fa2e-87bf-4261-b2f0-d05c85ca9193_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/6676b3d7-0786-4e62-90e9-7e29403379d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/737a0098-9750-4d26-af96-30a894722862_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/2b9f4cfa-ca99-44f7-abf6-e43ff3334672_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/251df07e-0df8-4e44-b3c9-bed7d5e1a753_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/06b63b4b-8051-45a7-8ba9-1ec9567c4c3f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24- 5k, 12/24- 13k', 'remarks': 'ADAPTIONS REMOVED - HOIST, spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/666a4d98-a5da-4844-9bb6-59c23e626526.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117471399, 'registration': 'LV72UBN', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 17386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 105}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV72UBN/2025-11-25/image/af08cb06-4a3b-4f1c-afbd-9d3ad87449b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/97e3a558-7456-43ff-8878-990d8a591c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/2982fa2e-87bf-4261-b2f0-d05c85ca9193_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/6676b3d7-0786-4e62-90e9-7e29403379d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/737a0098-9750-4d26-af96-30a894722862_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/2b9f4cfa-ca99-44f7-abf6-e43ff3334672_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/251df07e-0df8-4e44-b3c9-bed7d5e1a753_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-11-25/image/06b63b4b-8051-45a7-8ba9-1ec9567c4c3f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24- 5k, 12/24- 13k', 'remarks': 'ADAPTIONS REMOVED - HOIST, spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/666a4d98-a5da-4844-9bb6-59c23e626526.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399
2025-11-27 19:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with scrape type 2
2025-11-27 19:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with scrape type 2
2025-11-27 19:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265, identifier: 117471399
2025-11-27 19:05:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116941457, 'registration': 'RE22UKA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 29354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UKA/2025-11-10/image/6ecaddbf-1520-426d-943c-d22e065afdee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/d6658533-68aa-4dea-8c7c-196a4ba0543e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/5edbadf2-7fc2-4b37-9553-11ee86ff5d42_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/d0bc8e2a-42a2-400d-a4fb-3d1aa86fc758_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/dceec8a1-795f-4996-89e3-055205b29efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/ec5bd8a9-5d2c-4417-a671-e9398d0fab91_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/580565a0-ecb3-47fb-b310-7b1e8377150e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/cecfdb28-4c40-4954-b5ec-6635ecfd35be_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, Metallic - Reflex silver, Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ad57c46-9149-47a0-8af5-a7c58537e42f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116941457, 'registration': 'RE22UKA', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 29354, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UKA/2025-11-10/image/6ecaddbf-1520-426d-943c-d22e065afdee_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/d6658533-68aa-4dea-8c7c-196a4ba0543e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/5edbadf2-7fc2-4b37-9553-11ee86ff5d42_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/d0bc8e2a-42a2-400d-a4fb-3d1aa86fc758_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/dceec8a1-795f-4996-89e3-055205b29efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/ec5bd8a9-5d2c-4417-a671-e9398d0fab91_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/580565a0-ecb3-47fb-b310-7b1e8377150e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKA/2025-11-10/image/cecfdb28-4c40-4954-b5ec-6635ecfd35be_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY, Metallic - Reflex silver, Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ad57c46-9149-47a0-8af5-a7c58537e42f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eb35d75-b824-51b0-94fb-44037a80193a with identifier: 116941457
2025-11-27 19:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eb35d75-b824-51b0-94fb-44037a80193a with scrape type 2
2025-11-27 19:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1eb35d75-b824-51b0-94fb-44037a80193a with scrape type 2
2025-11-27 19:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1eb35d75-b824-51b0-94fb-44037a80193a, identifier: 116941457
2025-11-27 19:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542115?view=catalogue)
2025-11-27 19:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399
2025-11-27 19:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399
2025-11-27 19:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399 to the API
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265%27 HTTP/1.1" 200 None
2025-11-27 19:05:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117471399?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV72UBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117471399',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 17386,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-30',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Exclusive 5dr DCT',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471399%27 HTTP/1.1" 200 None
2025-11-27 19:05:24 [astonbarclay.gb] INFO: Saving data for 117471399: {'auction_closing_time': 1765275300.0, 'created_time': 1764061254.425599, 'last_price_update_time': 1764270324.392948}
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117471399') HTTP/1.1" 204 0
2025-11-27 19:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1eb35d75-b824-51b0-94fb-44037a80193a with identifier: 116941457
2025-11-27 19:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1eb35d75-b824-51b0-94fb-44037a80193a with identifier: 116941457
2025-11-27 19:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1eb35d75-b824-51b0-94fb-44037a80193a with identifier: 116941457 to the API
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116941457?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1eb35d75-b824-51b0-94fb-44037a80193a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22UKA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116941457',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 29354,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116941457%27 HTTP/1.1" 200 None
2025-11-27 19:05:24 [astonbarclay.gb] INFO: Saving data for 116941457: {'auction_closing_time': 1764842400.0, 'created_time': 1763147034.776152, 'last_price_update_time': 1764270324.702273}
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116941457') HTTP/1.1" 204 0
2025-11-27 19:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdf6950>
2025-11-27 19:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fe63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Found listing with ID: 117557140
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117557140%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Scrape type for 117557140: 1
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Feef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/eef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fe3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec43e50>
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec5d690>
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_10.jpg HTTP/1.1" 201 0
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F14390625-6024-4354-a128-687d753a8a83.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/14390625-6024-4354-a128-687d753a8a83.jpg?w=600 saved to cache
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec75f90>
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fe5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116557093, 'registration': 'GL74UKJ', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 8612, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN  - V5 Document Reference Number Available Upon Purchase"', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b69ac6ab-2958-489d-aa02-4d509789b75b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116557093, 'registration': 'GL74UKJ', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 8612, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN  - V5 Document Reference Number Available Upon Purchase"', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b69ac6ab-2958-489d-aa02-4d509789b75b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093
2025-11-27 19:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with scrape type 1
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fd9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Found listing with ID: 117507396
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507396%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Scrape type for 117507396: 0
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Found listing with ID: 116265155
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116265155%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Scrape type for 116265155: 0
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Found listing with ID: 117561133
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561133%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [astonbarclay.gb] INFO: Scrape type for 117561133: 1
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252F444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d30a8d0>
2025-11-27 19:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ19KXH%252F2025-11-27%252Fimage%252F72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3feb7045-82ed-5742-a0b6-0794db7b4720
2025-11-27 19:05:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3feb7045-82ed-5742-a0b6-0794db7b4720, skipping ID generation
2025-11-27 19:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3feb7045-82ed-5742-a0b6-0794db7b4720 with scrape type 1
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3feb7045-82ed-5742-a0b6-0794db7b4720 from tracking dictionaries
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3feb7045-82ed-5742-a0b6-0794db7b4720 sending to next pipeline
2025-11-27 19:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3feb7045-82ed-5742-a0b6-0794db7b4720, identifier: 117542115
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d15ea50>
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9e8d16d0>
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_12.jpg HTTP/1.1" 201 0
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg?w=600 saved to cache
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/db60a4e1-6ab8-414a-93d5-070e6ce10731.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549056?view=catalogue)
2025-11-27 19:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue)
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115
2025-11-27 19:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115
2025-11-27 19:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3feb7045-82ed-5742-a0b6-0794db7b4720 with identifier: 117542115 to the API
2025-11-27 19:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3feb7045-82ed-5742-a0b6-0794db7b4720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ19KXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117542115',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 78497,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33204,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7c460db8-e1fb-4bdd-bb1a-2ed710367b96_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35991,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/76b3a07e-5b81-4fd7-85f5-0a0f59528ac6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35381,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/ff2b822c-f4bc-49c9-8b50-4973c404d3be_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34532,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/fcffe57a-859f-4590-8798-d17482780969_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33082,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/1c20d1bd-d768-40c7-9b0a-9cfda798cc8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30445,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/86f59198-89dc-4ae9-a4d8-e631075b54a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29021,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/0b8971ea-4368-48e8-8e60-3db2944fe3c2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47718,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/72974111-97e0-4d0c-b45b-09a8e4cfea93_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41017,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/f85f1c49-d468-45db-bd4c-fa012309855f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45548,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/7e4f09fa-cae7-44e8-be75-4002ed9f29df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3feb7045-82ed-5742-a0b6-0794db7b4720/3feb7045-82ed-5742-a0b6-0794db7b4720_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31650,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ19KXH/2025-11-27/image/8974ac51-b0d3-492b-9d70-cbe4c46e6176_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-18',
 'seller_name': 'UKCGR - Premium',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2019}
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542115%27 HTTP/1.1" 200 None
2025-11-27 19:05:27 [astonbarclay.gb] INFO: Saving data for 117542115: {'created_time': 1764270327.129631, 'last_price_update_time': 1764270327.129642, 'auction_closing_time': 1764756000.0}
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117542115') HTTP/1.1" 204 0
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb13490>
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe11f90>
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fa7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117544234
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544234%27 HTTP/1.1" 200 None
2025-11-27 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117544234: 0
2025-11-27 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117106625
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117106625%27 HTTP/1.1" 200 None
2025-11-27 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117106625: 0
2025-11-27 19:05:27 [astonbarclay.gb] INFO: Found listing with ID: 117550449
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550449%27 HTTP/1.1" 200 None
2025-11-27 19:05:27 [astonbarclay.gb] INFO: Scrape type for 117550449: 1
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fd9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550264?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd7a9d0>
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feffa10>
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg?w=600 saved to cache
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Ff7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec23a10>
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb5710>
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Fa6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:28 [astonbarclay.gb] INFO: Found listing with ID: 116269848
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116269848%27 HTTP/1.1" 200 None
2025-11-27 19:05:28 [astonbarclay.gb] INFO: Scrape type for 116269848: 0
2025-11-27 19:05:28 [astonbarclay.gb] INFO: Found listing with ID: 117514603
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514603%27 HTTP/1.1" 200 None
2025-11-27 19:05:28 [astonbarclay.gb] INFO: Scrape type for 117514603: 2
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116645477?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e83f0d0>
2025-11-27 19:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fc0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feea8d0>
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fdb60a4e1-6ab8-414a-93d5-070e6ce10731.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/db60a4e1-6ab8-414a-93d5-070e6ce10731.jpg?w=600 saved to cache
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14715ba9-8474-5591-9162-f49cb89b6d88
2025-11-27 19:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14715ba9-8474-5591-9162-f49cb89b6d88, skipping ID generation
2025-11-27 19:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14715ba9-8474-5591-9162-f49cb89b6d88 with scrape type 1
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 14715ba9-8474-5591-9162-f49cb89b6d88 from tracking dictionaries
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14715ba9-8474-5591-9162-f49cb89b6d88 sending to next pipeline
2025-11-27 19:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 14715ba9-8474-5591-9162-f49cb89b6d88, identifier: 117549056
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee1e50>
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY72DFC%252F2025-11-20%252Fimage%252F2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5104a921-562c-5392-ba72-2df013980db0
2025-11-27 19:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5104a921-562c-5392-ba72-2df013980db0, skipping ID generation
2025-11-27 19:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5104a921-562c-5392-ba72-2df013980db0 with scrape type 1
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5104a921-562c-5392-ba72-2df013980db0 from tracking dictionaries
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5104a921-562c-5392-ba72-2df013980db0 sending to next pipeline
2025-11-27 19:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5104a921-562c-5392-ba72-2df013980db0, identifier: 117369086
2025-11-27 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/eef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 14715ba9-8474-5591-9162-f49cb89b6d88 with identifier: 117549056
2025-11-27 19:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 14715ba9-8474-5591-9162-f49cb89b6d88 with identifier: 117549056
2025-11-27 19:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 14715ba9-8474-5591-9162-f49cb89b6d88 with identifier: 117549056 to the API
2025-11-27 19:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/db60a4e1-6ab8-414a-93d5-070e6ce10731.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '14715ba9-8474-5591-9162-f49cb89b6d88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX22XJT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549056',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 30167,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68360,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/8a996a89-7f1d-4a13-bc4e-3cc999528af0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73779,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/7fdd3b4e-46c1-4fe6-8b13-c969bba1fe93.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78028,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/08f0fdf0-cd45-4c7c-9726-f070ac00e066.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69401,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/2ed535b4-8820-4b16-b293-9a1444afb8b8.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63540,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/db60a4e1-6ab8-414a-93d5-070e6ce10731.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78833,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/5d009754-2810-4387-9bbb-0e5975ea695b.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73373,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/c95ee6d2-2510-44be-8435-3fc5a8915b50.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70567,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/08d0e45f-1c11-4dcc-a53c-9406fbfb6cd1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49972,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/b454aa14-d8d5-496d-8028-9facbae5f1cd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54674,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/852f5928-a8b6-4e70-9acc-b4444d9930a1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53726,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/14390625-6024-4354-a128-687d753a8a83.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62307,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/ba07770f-fb5d-4cd2-8de7-438fe592f2e1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51245,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/002dffd4-6ceb-45b5-87db-57f8865e22f2.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42758,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/3d246d9c-26bb-4de7-98a9-308695b4e667.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14715ba9-8474-5591-9162-f49cb89b6d88/14715ba9-8474-5591-9162-f49cb89b6d88_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61637,
             'Height': 338,
             'OriginUrl': 'https://abimg002.imgix.net/62ad253b-070e-4aee-9c7f-791dfdddcff9.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-14',
 'seller_name': 'Hedin Automotive',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549056%27 HTTP/1.1" 200 None
2025-11-27 19:05:30 [astonbarclay.gb] INFO: Saving data for 117549056: {'created_time': 1764270330.305769, 'last_price_update_time': 1764270330.30578, 'auction_closing_time': 1764756000.0}
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549056') HTTP/1.1" 204 0
2025-11-27 19:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5104a921-562c-5392-ba72-2df013980db0 with identifier: 117369086
2025-11-27 19:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5104a921-562c-5392-ba72-2df013980db0 with identifier: 117369086
2025-11-27 19:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17931, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117369086', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gy72dfc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '5104a921-562c-5392-ba72-2df013980db0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28411}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 26913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 26724}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 25401}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 50877}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39103}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 47534}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 42645}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 28857} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '5104a921-562c-5392-ba72-2df013980db0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gy72dfc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117369086',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 17931,
     'odometer_in_km': 28857,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28411,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26913,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26724,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25401,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50877,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39103,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47534,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42645,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-09',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 5104a921-562c-5392-ba72-2df013980db0 spider: astonbarclay.gb
2025-11-27 19:05:30 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5104a921-562c-5392-ba72-2df013980db0 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 8, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17931, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117369086', 'expiration_date': '2025-12-04t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gy72dfc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '5104a921-562c-5392-ba72-2df013980db0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 28411}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 26913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 26724}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 25401}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 50877}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 39103}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 47534}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600', 'Width': 600, 'Height': 375, 'Extension': 'jpg', 'FileSizeInBytes': 42645}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 28857} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-04t10:00:00z',
     'fuel_type': 'electric',
     'id': '5104a921-562c-5392-ba72-2df013980db0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gy72dfc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117369086',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 17931,
     'odometer_in_km': 28857,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 8,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 28411,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26913,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26724,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 25401,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50877,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39103,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47534,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42645,
                 'Height': 375,
                 'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-09',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '5104a921-562c-5392-ba72-2df013980db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GY72DFC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117369086',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 17931,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28411,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26913,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26724,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25401,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50877,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39103,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47534,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5104a921-562c-5392-ba72-2df013980db0/5104a921-562c-5392-ba72-2df013980db0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42645,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117369086%27 HTTP/1.1" 200 None
2025-11-27 19:05:30 [astonbarclay.gb] INFO: Saving data for 117369086: {'created_time': 1764270330.643482, 'last_price_update_time': 1764270330.643489, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117369086') HTTP/1.1" 204 0
2025-11-27 19:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece8c90>
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e850590>
2025-11-27 19:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117552056, 'registration': 'EO74UMU', 'account': 'WBA001', 'make': 'RENAULT', 'model': 'SCENIC E-TECH ELECTRIC ESTATE', 'derivative': '160kW Techno 87kWh Long Range 5dr Auto', 'mileage': 4332, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2024-09-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb0be7c-f109-4bff-a5be-5cda67617415.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117552056, 'registration': 'EO74UMU', 'account': 'WBA001', 'make': 'RENAULT', 'model': 'SCENIC E-TECH ELECTRIC ESTATE', 'derivative': '160kW Techno 87kWh Long Range 5dr Auto', 'mileage': 4332, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2024-09-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb0be7c-f109-4bff-a5be-5cda67617415.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e with identifier: 117552056
2025-11-27 19:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e with scrape type 1
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550264, 'registration': 'LM25DFA', 'account': 'MOT070', 'make': 'CUPRA', 'model': 'FORMENTOR ESTATE', 'derivative': '1.5 eTSI 150 V1 5dr DSG', 'mileage': 1393, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8a8e201-467a-48f1-9264-628001fd09ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550264, 'registration': 'LM25DFA', 'account': 'MOT070', 'make': 'CUPRA', 'model': 'FORMENTOR ESTATE', 'derivative': '1.5 eTSI 150 V1 5dr DSG', 'mileage': 1393, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8a8e201-467a-48f1-9264-628001fd09ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264
2025-11-27 19:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f4874c-2c33-5c1b-b077-9222afab4ab8 with scrape type 1
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d6f4874c-2c33-5c1b-b077-9222afab4ab8
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d6f4874c-2c33-5c1b-b077-9222afab4ab8
2025-11-27 19:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6f4874c-2c33-5c1b-b077-9222afab4ab8, identifier: 117550264
2025-11-27 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Found listing with ID: 115917907
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115917907%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Scrape type for 115917907: 0
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Found listing with ID: 117015819
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015819%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Scrape type for 117015819: 1
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116361929?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264
2025-11-27 19:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264
2025-11-27 19:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264 to the API
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d6f4874c-2c33-5c1b-b077-9222afab4ab8%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d6f4874c-2c33-5c1b-b077-9222afab4ab8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550264?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd6f4874c-2c33-5c1b-b077-9222afab4ab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LM25DFA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550264',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CUPRA',
 'model': 'FORMENTOR ESTATE',
 'odometer': 1393,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-27',
 'seller_name': 'Motability Operations',
 'title': 'CUPRA FORMENTOR ESTATE 1.5 eTSI 150 V1 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 eTSI 150 V1 5dr DSG',
 'vin': None,
 'year': 2025}
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550264%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Saving data for 117550264: {'created_time': 1764270331.767026, 'last_price_update_time': 1764270331.767035, 'auction_closing_time': 1765792800.0}
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550264') HTTP/1.1" 204 0
2025-11-27 19:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec95990>
2025-11-27 19:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252F4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116500039, 'registration': 'EF22XOZ', 'account': 'MOT070', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 Titanium Edition 5dr Auto AWD', 'mileage': 19583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-23', 'fuel': 'Diesel', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 15K', 'remarks': 'VOSA STATES, 19K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e399081-4093-41dc-ac03-f035553bd921.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116500039, 'registration': 'EF22XOZ', 'account': 'MOT070', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 Titanium Edition 5dr Auto AWD', 'mileage': 19583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-23', 'fuel': 'Diesel', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 15K', 'remarks': 'VOSA STATES, 19K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e399081-4093-41dc-ac03-f035553bd921.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039
2025-11-27 19:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95151d0a-5a69-529c-babd-8bdf3c4858ea with scrape type 1
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DP69NVX/2025-11-24/image/444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117402247?view=catalogue)
2025-11-27 19:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac5c10>
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea68d50>
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fe3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116645477, 'registration': 'GX24XVC', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 5588, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX24XVC/2025-10-24/image/38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/d2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/b3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf45fbb-9497-4082-9d1b-093975299eed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116645477, 'registration': 'GX24XVC', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 5588, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX24XVC/2025-10-24/image/38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/d2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/b3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf45fbb-9497-4082-9d1b-093975299eed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477
2025-11-27 19:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 367bcedf-2a69-56d4-9405-4559622746e0 with scrape type 1
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 367bcedf-2a69-56d4-9405-4559622746e0
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252Fd2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/d2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252Fb3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/b3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGX24XVC%252F2025-10-24%252Fimage%252F82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GX24XVC/2025-10-24/image/82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg?w=600 already downloaded
2025-11-27 19:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 367bcedf-2a69-56d4-9405-4559622746e0, identifier: 116645477
2025-11-27 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:32 [astonbarclay.gb] INFO: Found listing with ID: 117567350
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567350%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [astonbarclay.gb] INFO: Scrape type for 117567350: 1
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477
2025-11-27 19:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477
2025-11-27 19:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477 to the API
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116645477?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '367bcedf-2a69-56d4-9405-4559622746e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX24XVC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116645477',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'ATECA ESTATE',
 'odometer': 5588,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photo_urls': ['https://abimg003.imgix.net/GX24XVC/2025-10-24/image/38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/d2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/b3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg?w=600',
                'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40309,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40755,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39664,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/d2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38172,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38526,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60998,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45257,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/b3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52431,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48768,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_367bcedf-2a69-56d4-9405-4559622746e0/367bcedf-2a69-56d4-9405-4559622746e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54912,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-10',
 'seller_name': 'Motability Operations',
 'title': 'SEAT ATECA ESTATE 1.5 TSI EVO Xperience 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI EVO Xperience 5dr DSG',
 'vin': None,
 'year': 2024}
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116645477%27 HTTP/1.1" 200 None
2025-11-27 19:05:33 [astonbarclay.gb] INFO: Saving data for 116645477: {'created_time': 1764270333.325648, 'last_price_update_time': 1764270333.325658, 'auction_closing_time': 1765792800.0}
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116645477') HTTP/1.1" 204 0
2025-11-27 19:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaae210>
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fd9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8febf790>
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252Feef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/eef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Faeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe8c750>
2025-11-27 19:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe5d790>
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116361929, 'registration': 'RE22UKD', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 35351, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-02', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UKD/2025-10-15/image/a9213e7a-4511-4de9-a21f-e49975328949_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/a1017419-a7ec-4496-9c93-03f9a0abb87b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/53f95e9e-343c-49b2-930e-3531bc63beec_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/0c68e83b-1601-4ac1-a466-9c3abdb315f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/1093412a-bf30-4684-9220-b1b0f2b33683_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/d3f0c8ba-9a7e-416f-b419-05deb226a5c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/08422aa3-c1d8-4ccc-9e94-9e5cd317bcc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/0e6d3f79-d00f-48f2-83b6-86f5e8f867ad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY, vosa states 32k, *Metallic - Atlantic blue, Maze cloth - Soul*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bf3c072-b880-4b6c-ba24-6196b2f81487.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116361929, 'registration': 'RE22UKD', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 35351, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-02', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UKD/2025-10-15/image/a9213e7a-4511-4de9-a21f-e49975328949_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/a1017419-a7ec-4496-9c93-03f9a0abb87b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/53f95e9e-343c-49b2-930e-3531bc63beec_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/0c68e83b-1601-4ac1-a466-9c3abdb315f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/1093412a-bf30-4684-9220-b1b0f2b33683_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/d3f0c8ba-9a7e-416f-b419-05deb226a5c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/08422aa3-c1d8-4ccc-9e94-9e5cd317bcc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UKD/2025-10-15/image/0e6d3f79-d00f-48f2-83b6-86f5e8f867ad_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY, vosa states 32k, *Metallic - Atlantic blue, Maze cloth - Soul*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bf3c072-b880-4b6c-ba24-6196b2f81487.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e64ee0-36af-5d69-8cb8-116292c804a3 with identifier: 116361929
2025-11-27 19:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e64ee0-36af-5d69-8cb8-116292c804a3 with scrape type 2
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e64ee0-36af-5d69-8cb8-116292c804a3 with scrape type 2
2025-11-27 19:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b4e64ee0-36af-5d69-8cb8-116292c804a3, identifier: 116361929
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 114344014, 'registration': 'LO22KXH', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi GT Premium 5dr EAT8', 'mileage': 27677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-04-22', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 06/23- 11K, 06/24- 17K, 04/25- 25K', 'remarks': 'VOSA STATES 25K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0b32466-4ae0-40b1-9dcd-8105f76fcb18.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 114344014, 'registration': 'LO22KXH', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi GT Premium 5dr EAT8', 'mileage': 27677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-04-22', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 06/23- 11K, 06/24- 17K, 04/25- 25K', 'remarks': 'VOSA STATES 25K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0b32466-4ae0-40b1-9dcd-8105f76fcb18.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014
2025-11-27 19:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with scrape type 1
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252Fc26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Found listing with ID: 116617318
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Scrape type for 116617318: 0
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Found listing with ID: 117549930
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549930%27 HTTP/1.1" 200 None
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Scrape type for 117549930: 1
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fe991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b4e64ee0-36af-5d69-8cb8-116292c804a3 with identifier: 116361929
2025-11-27 19:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b4e64ee0-36af-5d69-8cb8-116292c804a3 with identifier: 116361929
2025-11-27 19:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b4e64ee0-36af-5d69-8cb8-116292c804a3 with identifier: 116361929 to the API
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116361929?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b4e64ee0-36af-5d69-8cb8-116292c804a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22UKD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116361929',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 35351,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116361929%27 HTTP/1.1" 200 None
2025-11-27 19:05:34 [astonbarclay.gb] INFO: Saving data for 116361929: {'auction_closing_time': 1764842400.0, 'created_time': 1763146989.627809, 'last_price_update_time': 1764270334.834555}
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116361929') HTTP/1.1" 204 0
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb06850>
2025-11-27 19:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDP69NVX%252F2025-11-24%252Fimage%252F444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DP69NVX/2025-11-24/image/444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 346adf39-4e69-5b8b-98d3-9427ca089574
2025-11-27 19:05:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 346adf39-4e69-5b8b-98d3-9427ca089574, skipping ID generation
2025-11-27 19:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346adf39-4e69-5b8b-98d3-9427ca089574 with scrape type 1
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 346adf39-4e69-5b8b-98d3-9427ca089574 from tracking dictionaries
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 346adf39-4e69-5b8b-98d3-9427ca089574 sending to next pipeline
2025-11-27 19:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 346adf39-4e69-5b8b-98d3-9427ca089574, identifier: 117402247
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e914c10>
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550696, 'registration': 'EX19ZNK', 'account': 'WBA001', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 ST-Line 3dr', 'mileage': 25705, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/20-5k,  04/21-7k,  05/23-17k,  04/25-23k', 'remarks': 'SPARE KEY - VOSA STATES 12k 16k 20k 23k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e1a1f6b2-45a5-4582-b6c1-9dc2e913ccde.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550696, 'registration': 'EX19ZNK', 'account': 'WBA001', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 140 ST-Line 3dr', 'mileage': 25705, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 3, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/20-5k,  04/21-7k,  05/23-17k,  04/25-23k', 'remarks': 'SPARE KEY - VOSA STATES 12k 16k 20k 23k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e1a1f6b2-45a5-4582-b6c1-9dc2e913ccde.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696
2025-11-27 19:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with scrape type 1
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Fdbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117553434, 'registration': 'GD21LPJ', 'account': 'WBA001', 'make': 'AUDI', 'model': 'A4 DIESEL SALOON', 'derivative': '35 TDI S Line 4dr S Tronic', 'mileage': 64059, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-06-23', 'fuel': 'Diesel', 'motExpiry': '2026-04-30', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/c06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/de0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/ad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 42k 59k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/855995ad-2891-43bf-adad-074f7ec9bd90.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117553434, 'registration': 'GD21LPJ', 'account': 'WBA001', 'make': 'AUDI', 'model': 'A4 DIESEL SALOON', 'derivative': '35 TDI S Line 4dr S Tronic', 'mileage': 64059, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-06-23', 'fuel': 'Diesel', 'motExpiry': '2026-04-30', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/c06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/de0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/ad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 42k 59k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/855995ad-2891-43bf-adad-074f7ec9bd90.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e52dead7-8e3d-5a7c-bf29-acca1f468abb with identifier: 117553434
2025-11-27 19:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52dead7-8e3d-5a7c-bf29-acca1f468abb with scrape type 1
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252Fc06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/c06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fbb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252Fb3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 346adf39-4e69-5b8b-98d3-9427ca089574 with identifier: 117402247
2025-11-27 19:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 346adf39-4e69-5b8b-98d3-9427ca089574 with identifier: 117402247
2025-11-27 19:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 346adf39-4e69-5b8b-98d3-9427ca089574 with identifier: 117402247 to the API
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DP69NVX/2025-11-24/image/444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '346adf39-4e69-5b8b-98d3-9427ca089574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DP69NVX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117402247',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 85188,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25428,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/29c09a18-a28e-4720-a067-7a0960960a3f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26104,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e63cfdc2-4ae1-4dcf-a17f-e6a2279d2358_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22707,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/e5bef142-d4ee-439c-ab75-49c9f8750cab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24426,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a7b65278-f933-4591-bc92-b15ce71d0333_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47923,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/a6f689d4-6e8d-44f5-bac5-cf7772264fa1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37815,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/4f4ea4be-52af-428b-9bd3-5e5969633684_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51814,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/eef913f8-9de4-49a5-bd55-cbb5c61f70a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_346adf39-4e69-5b8b-98d3-9427ca089574/346adf39-4e69-5b8b-98d3-9427ca089574_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44283,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/DP69NVX/2025-11-24/image/444644c7-c579-4caf-98ea-43fd404f9a57_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.0 TSI 115 Match Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 115 Match Edition 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402247%27 HTTP/1.1" 200 None
2025-11-27 19:05:35 [astonbarclay.gb] INFO: Saving data for 117402247: {'created_time': 1764270335.897649, 'last_price_update_time': 1764270335.897662, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117402247') HTTP/1.1" 204 0
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c72fa50>
2025-11-27 19:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252F38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c72f090>
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fd9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:36 [astonbarclay.gb] INFO: Found listing with ID: 117549984
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549984%27 HTTP/1.1" 200 None
2025-11-27 19:05:36 [astonbarclay.gb] INFO: Scrape type for 117549984: 1
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fb1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee8310>
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Ff7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec87ad0>
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099256?view=catalogue)
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fc27f71ef-da61-415d-981f-574884694df2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252Fb9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252Fb474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d5142d0>
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e909910>
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:05:37 [astonbarclay.gb] INFO: Found listing with ID: 117552007
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552007%27 HTTP/1.1" 200 None
2025-11-27 19:05:37 [astonbarclay.gb] INFO: Scrape type for 117552007: 1
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Fb60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252Fde0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/de0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab0210>
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d453f10>
2025-11-27 19:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fcf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80b390>
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec2ce10>
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550449, 'registration': 'HN70XOS', 'account': 'WBA001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE 5dr Step Auto', 'mileage': 47310, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-11-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-05', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/f878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/b568095a-3355-4973-98f0-2958a93d0608_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 33k 40k 46k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a140320-8885-4cd7-9f07-c9ac5b906c26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550449, 'registration': 'HN70XOS', 'account': 'WBA001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE 5dr Step Auto', 'mileage': 47310, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-11-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-05', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/f878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/b568095a-3355-4973-98f0-2958a93d0608_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 33k 40k 46k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a140320-8885-4cd7-9f07-c9ac5b906c26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abce0ce0-bd74-5873-a784-b93165797942 with identifier: 117550449
2025-11-27 19:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abce0ce0-bd74-5873-a784-b93165797942 with scrape type 1
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/c06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:05:38 [astonbarclay.gb] INFO: Found listing with ID: 117570270
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570270%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [astonbarclay.gb] INFO: Scrape type for 117570270: 1
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252Fad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/ad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea78450>
2025-11-27 19:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9ef050>
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e81cf50>
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMJ21HCG%252F2025-11-17%252Fimage%252F41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44818002-d623-5739-bbbb-81e35c31515d
2025-11-27 19:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44818002-d623-5739-bbbb-81e35c31515d, skipping ID generation
2025-11-27 19:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44818002-d623-5739-bbbb-81e35c31515d with scrape type 1
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 44818002-d623-5739-bbbb-81e35c31515d from tracking dictionaries
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44818002-d623-5739-bbbb-81e35c31515d sending to next pipeline
2025-11-27 19:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 44818002-d623-5739-bbbb-81e35c31515d, identifier: 117099256
2025-11-27 19:05:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117557140, 'registration': 'DV21HLM', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 SE 5dr Auto', 'mileage': 39316, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-07-16', 'fuel': 'Petrol', 'motExpiry': '2026-07-15', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV21HLM/2025-11-27/image/20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/ea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/347caf59-67f8-4388-9a2a-497615d239a4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117557140, 'registration': 'DV21HLM', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 SE 5dr Auto', 'mileage': 39316, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-07-16', 'fuel': 'Petrol', 'motExpiry': '2026-07-15', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV21HLM/2025-11-27/image/20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/ea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/347caf59-67f8-4388-9a2a-497615d239a4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b3281e-64c7-584b-ab9b-2103315ea806 with identifier: 117557140
2025-11-27 19:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b3281e-64c7-584b-ab9b-2103315ea806 with scrape type 1
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117561133, 'registration': 'BL65TAR', 'account': 'WBA001', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro Black Edition 5dr S Tronic', 'mileage': 53728, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL65TAR/2025-11-27/image/36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/c53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/cccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/a7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/de6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/21- 7K, 10/22- 22K, 09/23- 32K, 12/24- 49K, 11/25- 53K', 'remarks': 'VOSA STATES 28K, 45K, 50K, SPARE KEY IN OFFICE, **GHOST ALARM FITTED, PRINTED INSTRUCTIONS IN OFFICE**', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 194, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7b4e177-101e-4cca-8782-dbcb1e2aa645.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117561133, 'registration': 'BL65TAR', 'account': 'WBA001', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro Black Edition 5dr S Tronic', 'mileage': 53728, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL65TAR/2025-11-27/image/36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/c53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/cccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/a7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/de6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/21- 7K, 10/22- 22K, 09/23- 32K, 12/24- 49K, 11/25- 53K', 'remarks': 'VOSA STATES 28K, 45K, 50K, SPARE KEY IN OFFICE, **GHOST ALARM FITTED, PRINTED INSTRUCTIONS IN OFFICE**', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 194, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7b4e177-101e-4cca-8782-dbcb1e2aa645.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2bd93c2-a743-5722-b8fa-4e4d115759ac with identifier: 117561133
2025-11-27 19:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bd93c2-a743-5722-b8fa-4e4d115759ac with scrape type 1
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 44818002-d623-5739-bbbb-81e35c31515d with identifier: 117099256
2025-11-27 19:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 44818002-d623-5739-bbbb-81e35c31515d with identifier: 117099256
2025-11-27 19:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 44818002-d623-5739-bbbb-81e35c31515d with identifier: 117099256 to the API
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '44818002-d623-5739-bbbb-81e35c31515d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ21HCG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099256',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 45366,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33466,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/74b5d95a-26e3-409d-b6bd-8c1358c7f969_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32531,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ed81b3f-a722-4f08-a65e-4fbe24c3ce27_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34056,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/1b99dcd3-549b-41e7-aa94-f0a03e847ff2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32758,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/04495edc-adc1-4826-91a5-5d708afbdb2f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45890,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/5a7a0d9e-7419-4709-b49e-6c47e358f0c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66638,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/50aa5086-5872-4595-b636-b1eae687892d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62683,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/8ddea3d0-7c7f-43a1-9ec6-554d18dbdb4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44818002-d623-5739-bbbb-81e35c31515d/44818002-d623-5739-bbbb-81e35c31515d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65459,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MJ21HCG/2025-11-17/image/41264475-fb52-4488-b582-c46e8b424d1f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': 'Kinto',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099256%27 HTTP/1.1" 200 None
2025-11-27 19:05:40 [astonbarclay.gb] INFO: Saving data for 117099256: {'created_time': 1764270340.354759, 'last_price_update_time': 1764270340.354769, 'auction_closing_time': 1764842400.0}
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099256') HTTP/1.1" 204 0
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb12890>
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec23710>
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:05:41 [astonbarclay.gb] INFO: Found listing with ID: 117550785
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550785%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [astonbarclay.gb] INFO: Scrape type for 117550785: 1
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec4c110>
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252Fc26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e95bf50>
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252Fa1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252Ff878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/f878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fec4490>
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Fdbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e825d90>
2025-11-27 19:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252Fc06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/c06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/de0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:05:42 [astonbarclay.gb] INFO: Found listing with ID: 117550047
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550047%27 HTTP/1.1" 200 None
2025-11-27 19:05:42 [astonbarclay.gb] INFO: Scrape type for 117550047: 1
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252Fe4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fc53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/c53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb78710>
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e81c610>
2025-11-27 19:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe98c90>
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fbb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee5490>
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252Fb3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252Fb568095a-3355-4973-98f0-2958a93d0608_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/b568095a-3355-4973-98f0-2958a93d0608_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb67910>
2025-11-27 19:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d1be890>
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117515289, 'registration': 'NRZ4642', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.2 TCE 120 Dynamique S Nav 5dr EDC', 'mileage': 54853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-02-19', 'fuel': 'Petrol', 'motExpiry': '2026-02-20', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600'], 'colour': 'ORANGE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/19-6k,  08/19-10k,  11/19-11k,  11/20-16k,  11/21-22k,  12/22-30k,  11/23-38k,  11/24-47k', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10d12ff1-dbac-44d6-a1a5-89376d8c9b38.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117515289, 'registration': 'NRZ4642', 'account': 'WBA002', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.2 TCE 120 Dynamique S Nav 5dr EDC', 'mileage': 54853, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-02-19', 'fuel': 'Petrol', 'motExpiry': '2026-02-20', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600', 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600'], 'colour': 'ORANGE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/19-6k,  08/19-10k,  11/19-11k,  11/20-16k,  11/21-22k,  12/22-30k,  11/23-38k,  11/24-47k', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/10d12ff1-dbac-44d6-a1a5-89376d8c9b38.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289
2025-11-27 19:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with scrape type 1
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117015819, 'registration': 'YK68PMZ', 'account': 'MAN027', 'make': 'KIA', 'model': 'STONIC ESTATE', 'derivative': '1.0T GDi 3 5dr', 'mileage': 85543, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 2/20-10K, 1/21-19K, 1/22-27K, 1/23-36K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 27K, 36K, 44K, 66K SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ddfbd5c-d2d6-4968-a2e7-9bf4b27d2187.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117015819, 'registration': 'YK68PMZ', 'account': 'MAN027', 'make': 'KIA', 'model': 'STONIC ESTATE', 'derivative': '1.0T GDi 3 5dr', 'mileage': 85543, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 2/20-10K, 1/21-19K, 1/22-27K, 1/23-36K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 27K, 36K, 44K, 66K SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ddfbd5c-d2d6-4968-a2e7-9bf4b27d2187.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819
2025-11-27 19:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2010898b-61b7-5b42-aa87-6829b4572f48 with scrape type 1
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117514603?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea3a710>
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec5c310>
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fb1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252Fa88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e94cbd0>
2025-11-27 19:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Fb60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece8990>
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252Fde0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/de0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e934c10>
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252Fb9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaf7850>
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252Fb474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Ff02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fcccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/cccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdd2710>
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feaa210>
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252Fa719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fbaac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c703e50>
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fcf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e957210>
2025-11-27 19:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117542492, 'registration': 'ET19EOD', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X Auto 5dr', 'mileage': 82622, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-02', 'fuel': 'Diesel', 'motExpiry': '2026-10-15', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ET19EOD/2025-11-27/image/c9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/a4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/d48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/e7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/20-7K 12/20-14K 07/21-21K 04/22-33K 03/24-59K 11/24-68K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 37K 51K 66K 81K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0531cd2-7db6-4388-94e1-ce39175ba372.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117542492, 'registration': 'ET19EOD', 'account': 'WBA002', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X Auto 5dr', 'mileage': 82622, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-02', 'fuel': 'Diesel', 'motExpiry': '2026-10-15', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ET19EOD/2025-11-27/image/c9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/a4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/d48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/e7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/20-7K 12/20-14K 07/21-21K 04/22-33K 03/24-59K 11/24-68K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 37K 51K 66K 81K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0531cd2-7db6-4388-94e1-ce39175ba372.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 with identifier: 117542492
2025-11-27 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 with scrape type 1
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fc9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/c9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117514603, 'registration': 'GU72YFE', 'account': 'VWF001', 'make': 'AUDI', 'model': 'Q7 ESTATE', 'derivative': '55 TFSI Quattro Black Edition 5dr Tiptronic', 'mileage': 31617, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-10-19', 'fuel': 'Petrol', 'motExpiry': '2026-10-18', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YFE/2025-11-26/image/990b3c36-7e93-4e98-b00c-fc5e2e9155ac_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Volkswagen Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 234, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117514603, 'registration': 'GU72YFE', 'account': 'VWF001', 'make': 'AUDI', 'model': 'Q7 ESTATE', 'derivative': '55 TFSI Quattro Black Edition 5dr Tiptronic', 'mileage': 31617, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-10-19', 'fuel': 'Petrol', 'motExpiry': '2026-10-18', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YFE/2025-11-26/image/990b3c36-7e93-4e98-b00c-fc5e2e9155ac_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Volkswagen Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 234, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667d4ef7-49cf-56d0-88e8-1a0866602747 with identifier: 117514603
2025-11-27 19:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667d4ef7-49cf-56d0-88e8-1a0866602747 with scrape type 2
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667d4ef7-49cf-56d0-88e8-1a0866602747 with scrape type 2
2025-11-27 19:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 667d4ef7-49cf-56d0-88e8-1a0866602747, identifier: 117514603
2025-11-27 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/f878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252Fea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/ea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 667d4ef7-49cf-56d0-88e8-1a0866602747 with identifier: 117514603
2025-11-27 19:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 667d4ef7-49cf-56d0-88e8-1a0866602747 with identifier: 117514603
2025-11-27 19:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 667d4ef7-49cf-56d0-88e8-1a0866602747 with identifier: 117514603 to the API
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27667d4ef7-49cf-56d0-88e8-1a0866602747%27 HTTP/1.1" 200 None
2025-11-27 19:05:47 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 667d4ef7-49cf-56d0-88e8-1a0866602747: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:05:47 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117514603?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '667d4ef7-49cf-56d0-88e8-1a0866602747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72YFE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117514603',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q7 ESTATE',
 'odometer': 31617,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seller_name': 'Volkswagen Financial Services',
 'title': 'AUDI Q7 ESTATE 55 TFSI Quattro Black Edition 5dr Tiptronic',
 'transmission': 'automatic',
 'trim': '55 TFSI Quattro Black Edition 5dr Tiptronic',
 'vin': None,
 'year': 2022}
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514603%27 HTTP/1.1" 200 None
2025-11-27 19:05:47 [astonbarclay.gb] INFO: Saving data for 117514603: {'created_time': 1764147678.271571, 'last_price_update_time': 1764270347.82065}
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117514603') HTTP/1.1" 204 0
2025-11-27 19:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c702c50>
2025-11-27 19:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb47110>
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb46490>
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/c53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fd45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe58090>
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252F3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98dbd0>
2025-11-27 19:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98d1d0>
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Fd809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe438d0>
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe41cd0>
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/b568095a-3355-4973-98f0-2958a93d0608_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Ff56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fa4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/a4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e95eb10>
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd10390>
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9e794290>
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252Ff878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/f878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fa7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/a7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd58910>
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fc53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/c53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e852990>
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fddb010>
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e939ad0>
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c70e290>
2025-11-27 19:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/cccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d453750>
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252F9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0b58d0>
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ffff5d0>
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252Fb568095a-3355-4973-98f0-2958a93d0608_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/b568095a-3355-4973-98f0-2958a93d0608_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/c9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fed1650>
2025-11-27 19:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9964d0>
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9380d0>
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/ea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fde6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/de6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec76350>
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252Fa88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec776d0>
2025-11-27 19:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fd48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/d48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac59d0>
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fcccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/cccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecd9150>
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fec3fd0>
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fffe090>
2025-11-27 19:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fc9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/c9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb42f90>
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252Fa719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea60810>
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fbaac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/a4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252Fdb2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d18db50>
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb86410>
2025-11-27 19:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252Fea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/ea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/a7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe9c610>
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e815590>
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c726190>
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fd45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fe7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/e7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e82f010>
2025-11-27 19:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d15cd50>
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecb6b10>
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Ff56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e822a50>
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fa4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/a4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac4cd0>
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e823450>
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fa7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/a7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea00710>
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL65TAR/2025-11-27/image/de6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117561133?view=catalogue)
2025-11-27 19:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DV21HLM/2025-11-27/image/2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117557140?view=catalogue)
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0820d0>
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e940bd0>
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecb7ed0>
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/d48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaa7710>
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252F372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e994750>
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600 saved to cache
2025-11-27 19:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d6616d0>
2025-11-27 19:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d34b650>
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252Fec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ece22d0>
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue)
2025-11-27 19:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e927010>
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c73f610>
2025-11-27 19:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL65TAR%252F2025-11-27%252Fimage%252Fde6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL65TAR/2025-11-27/image/de6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2bd93c2-a743-5722-b8fa-4e4d115759ac
2025-11-27 19:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2bd93c2-a743-5722-b8fa-4e4d115759ac, skipping ID generation
2025-11-27 19:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bd93c2-a743-5722-b8fa-4e4d115759ac with scrape type 1
2025-11-27 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e2bd93c2-a743-5722-b8fa-4e4d115759ac from tracking dictionaries
2025-11-27 19:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2bd93c2-a743-5722-b8fa-4e4d115759ac sending to next pipeline
2025-11-27 19:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e2bd93c2-a743-5722-b8fa-4e4d115759ac, identifier: 117561133
2025-11-27 19:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c33dfd0>
2025-11-27 19:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDV21HLM%252F2025-11-27%252Fimage%252F2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DV21HLM/2025-11-27/image/2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23b3281e-64c7-584b-ab9b-2103315ea806
2025-11-27 19:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23b3281e-64c7-584b-ab9b-2103315ea806, skipping ID generation
2025-11-27 19:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b3281e-64c7-584b-ab9b-2103315ea806 with scrape type 1
2025-11-27 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 23b3281e-64c7-584b-ab9b-2103315ea806 from tracking dictionaries
2025-11-27 19:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23b3281e-64c7-584b-ab9b-2103315ea806 sending to next pipeline
2025-11-27 19:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 23b3281e-64c7-584b-ab9b-2103315ea806, identifier: 117557140
2025-11-27 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e2bd93c2-a743-5722-b8fa-4e4d115759ac with identifier: 117561133
2025-11-27 19:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e2bd93c2-a743-5722-b8fa-4e4d115759ac with identifier: 117561133
2025-11-27 19:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e2bd93c2-a743-5722-b8fa-4e4d115759ac with identifier: 117561133 to the API
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BL65TAR/2025-11-27/image/de6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e2bd93c2-a743-5722-b8fa-4e4d115759ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BL65TAR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117561133',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q5 DIESEL ESTATE',
 'odometer': 53728,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29323,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/36af98ce-d0f4-4fd5-9b7e-0a0401580d4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24309,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/53d16d40-5285-471b-b260-92ea761df5aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39167,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/c53f6eea-7688-400b-8fdc-b2189e5c9389_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36819,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/2f3e8681-591d-4e02-839d-bce0a8fe9672_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/cccc2f84-ca55-4c18-8ab7-5879323d8e06_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50395,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/482b2f5c-caf4-4780-825d-97f783c5f8fa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72855,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/58feacac-b1e9-428d-8036-e47dcf4ff26b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53079,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/a7b96d14-c4a4-48f3-b873-86be68fecf82_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49847,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/372a41da-82b9-4a69-9d58-4620c874de07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2bd93c2-a743-5722-b8fa-4e4d115759ac/e2bd93c2-a743-5722-b8fa-4e4d115759ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42492,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL65TAR/2025-11-27/image/de6076d6-5c9e-459f-8be8-4638a1060f62_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': 'UKCGR',
 'title': 'AUDI Q5 DIESEL ESTATE 40 TDI Quattro Black Edition 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TDI Quattro Black Edition 5dr S Tronic',
 'vin': None,
 'year': 2020}
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561133%27 HTTP/1.1" 200 None
2025-11-27 19:06:02 [astonbarclay.gb] INFO: Saving data for 117561133: {'created_time': 1764270362.497184, 'last_price_update_time': 1764270362.497194}
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117561133') HTTP/1.1" 204 0
2025-11-27 19:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 23b3281e-64c7-584b-ab9b-2103315ea806 with identifier: 117557140
2025-11-27 19:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 23b3281e-64c7-584b-ab9b-2103315ea806 with identifier: 117557140
2025-11-27 19:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 23b3281e-64c7-584b-ab9b-2103315ea806 with identifier: 117557140 to the API
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DV21HLM/2025-11-27/image/2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '23b3281e-64c7-584b-ab9b-2103315ea806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DV21HLM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117557140',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 39316,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34875,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/20e889db-d5f5-4b83-b3cf-f524ac2984e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33620,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/6693995c-7bb9-4260-a362-5f83cb4df712_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37528,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/3911f48e-9bac-43c1-b035-845a67e4fdfa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34100,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/0ff6377c-e41e-4957-9037-ba0ef6064119_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45217,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/79272be3-4edf-4f4b-9211-650cfbaeb151_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59340,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/ea8b83b3-1591-468e-9027-264db59a38f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46864,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4aa5f7e8-2058-4cac-9a53-1d538026bc07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70383,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/94cbfeda-636f-4841-8899-8b4165f991bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37203,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/4d248be2-c1fb-4a8f-b30c-163cccc4fee4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23b3281e-64c7-584b-ab9b-2103315ea806/23b3281e-64c7-584b-ab9b-2103315ea806_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51677,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DV21HLM/2025-11-27/image/2b949213-afc1-4c6c-a8f7-a8754e41a75f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-16',
 'seller_name': 'UKCGR',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A180 SE 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180 SE 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117557140%27 HTTP/1.1" 200 None
2025-11-27 19:06:02 [astonbarclay.gb] INFO: Saving data for 117557140: {'created_time': 1764270362.867755, 'last_price_update_time': 1764270362.867764}
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117557140') HTTP/1.1" 204 0
2025-11-27 19:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb44790>
2025-11-27 19:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaedb10>
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd70950>
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fd48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/d48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117515289?view=catalogue)
2025-11-27 19:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/e7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab3b10>
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_10.jpg HTTP/1.1" 201 0
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84f490>
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecb6f10>
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252Fdb2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9f4150>
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYK68PMZ%252F2025-11-07%252Fimage%252F6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2010898b-61b7-5b42-aa87-6829b4572f48
2025-11-27 19:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2010898b-61b7-5b42-aa87-6829b4572f48, skipping ID generation
2025-11-27 19:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2010898b-61b7-5b42-aa87-6829b4572f48 with scrape type 1
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2010898b-61b7-5b42-aa87-6829b4572f48 from tracking dictionaries
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2010898b-61b7-5b42-aa87-6829b4572f48 sending to next pipeline
2025-11-27 19:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2010898b-61b7-5b42-aa87-6829b4572f48, identifier: 117015819
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab0050>
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET19EOD/2025-11-27/image/2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542492?view=catalogue)
2025-11-27 19:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:06:04 [scrapy.extensions.logstats] INFO: Crawled 284 pages (at 32 pages/min), scraped 198 items (at 28 items/min)
2025-11-27 19:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819
2025-11-27 19:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819
2025-11-27 19:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819 to the API
2025-11-27 19:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '2010898b-61b7-5b42-aa87-6829b4572f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YK68PMZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117015819',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'STONIC ESTATE',
 'odometer': 85543,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34505,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35807,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36685,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35495,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46205,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52359,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36783,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2010898b-61b7-5b42-aa87-6829b4572f48/2010898b-61b7-5b42-aa87-6829b4572f48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39869,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seller_name': 'Mann Island Finance',
 'title': 'KIA STONIC ESTATE 1.0T GDi 3 5dr',
 'transmission': 'manual',
 'trim': '1.0T GDi 3 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015819%27 HTTP/1.1" 200 None
2025-11-27 19:06:05 [astonbarclay.gb] INFO: Saving data for 117015819: {'created_time': 1764270365.226441, 'last_price_update_time': 1764270365.226452}
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117015819') HTTP/1.1" 204 0
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e942e50>
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Fd809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84cb90>
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN70XOS/2025-11-27/image/23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550449?view=catalogue)
2025-11-27 19:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9f7a10>
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNRZ4642%252F2025-11-26%252Fimage%252F38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e
2025-11-27 19:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e, skipping ID generation
2025-11-27 19:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with scrape type 1
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e from tracking dictionaries
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e sending to next pipeline
2025-11-27 19:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e, identifier: 117515289
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e815050>
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252Fe7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/e7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea01190>
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue)
2025-11-27 19:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE%2FBLACK HTTP/1.1" 200 None
2025-11-27 19:06:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-11-27 19:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289
2025-11-27 19:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 74a14cf4-c2f2-5cff-bc72-ad31317e6f4e with identifier: 117515289 to the API
2025-11-27 19:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '74a14cf4-c2f2-5cff-bc72-ad31317e6f4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NRZ4642',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515289',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 54853,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39569,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/99fe0ccf-862c-48c1-b622-99253ff3409d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39748,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a88ac83f-e879-44d5-a658-7d6e08221025_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30497,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/a719c30e-901f-425f-b68c-f38bd110d0bc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32629,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/1efd0f00-6512-452e-abaa-98b933b2b8f8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56407,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9fb205ed-7273-4f9e-af2f-eadb8eb2f47a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51590,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/103b86f4-d800-4194-850f-ff5b30d5aae3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56608,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/375a81ef-23b0-48fd-bc8a-f4d8711613d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62527,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/9123ca56-e92a-4c0f-93bf-46ebb28f5122_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62063,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/db2d6591-c8ea-460b-9261-b56358bcf755_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74a14cf4-c2f2-5cff-bc72-ad31317e6f4e/74a14cf4-c2f2-5cff-bc72-ad31317e6f4e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62997,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NRZ4642/2025-11-26/image/38331cbc-5bc3-4803-bf6b-fe6e5a48e4af_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': 'UKCGR - Premium',
 'title': 'RENAULT CAPTUR HATCHBACK 1.2 TCE 120 Dynamique S Nav 5dr EDC',
 'transmission': 'automatic',
 'trim': '1.2 TCE 120 Dynamique S Nav 5dr EDC',
 'vin': None,
 'year': 2018}
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515289%27 HTTP/1.1" 200 None
2025-11-27 19:06:07 [astonbarclay.gb] INFO: Saving data for 117515289: {'created_time': 1764270367.185981, 'last_price_update_time': 1764270367.185991, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117515289') HTTP/1.1" 204 0
2025-11-27 19:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d082150>
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb4f10>
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e852f90>
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d146150>
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET19EOD%252F2025-11-27%252Fimage%252F2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET19EOD/2025-11-27/image/2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38
2025-11-27 19:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38, skipping ID generation
2025-11-27 19:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 with scrape type 1
2025-11-27 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 from tracking dictionaries
2025-11-27 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 sending to next pipeline
2025-11-27 19:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38, identifier: 117542492
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb75950>
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552056?view=catalogue)
2025-11-27 19:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 with identifier: 117542492
2025-11-27 19:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 with identifier: 117542492
2025-11-27 19:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9c6be869-2f79-555b-bc4a-b9ac6fcdfb38 with identifier: 117542492 to the API
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/ET19EOD/2025-11-27/image/2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9c6be869-2f79-555b-bc4a-b9ac6fcdfb38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ET19EOD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117542492',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS DIESEL ESTATE',
 'odometer': 82622,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32092,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/c9fe2d51-5b4e-4f4f-a464-95219f09a94e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30592,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/4d933ef8-8dfc-49ca-99e3-b44a6ee9c333_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29703,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/a4234af9-24ba-4bc3-87d1-4fc14015e5f5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30501,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/55320285-3d27-4322-bdb5-5a2680a473ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34724,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/189ce070-9b61-49ca-b603-87984dcfb034_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43753,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/d48dd049-ba08-46ee-909c-ff8ea6022dbb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40794,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/68bbadfd-0ec3-4b6d-b3c7-bddf4050251f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44649,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/e7fa2736-07cc-40f6-bb0b-15e22782759f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c6be869-2f79-555b-bc4a-b9ac6fcdfb38/9c6be869-2f79-555b-bc4a-b9ac6fcdfb38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37693,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET19EOD/2025-11-27/image/2e2b599b-e822-4c1f-baf0-8a6ebdaf7ea4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-02',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD FOCUS DIESEL ESTATE 1.5 EcoBlue 120 Active X Auto 5dr',
 'transmission': 'automatic',
 'trim': '1.5 EcoBlue 120 Active X Auto 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542492%27 HTTP/1.1" 200 None
2025-11-27 19:06:08 [astonbarclay.gb] INFO: Saving data for 117542492: {'created_time': 1764270368.976437, 'last_price_update_time': 1764270368.976447, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117542492') HTTP/1.1" 204 0
2025-11-27 19:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fef56d0>
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN70XOS%252F2025-11-27%252Fimage%252F23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN70XOS/2025-11-27/image/23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abce0ce0-bd74-5873-a784-b93165797942
2025-11-27 19:06:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abce0ce0-bd74-5873-a784-b93165797942, skipping ID generation
2025-11-27 19:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abce0ce0-bd74-5873-a784-b93165797942 with scrape type 1
2025-11-27 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item abce0ce0-bd74-5873-a784-b93165797942 from tracking dictionaries
2025-11-27 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abce0ce0-bd74-5873-a784-b93165797942 sending to next pipeline
2025-11-27 19:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: abce0ce0-bd74-5873-a784-b93165797942, identifier: 117550449
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c73dc90>
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/ad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117553434?view=catalogue)
2025-11-27 19:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550696?view=catalogue)
2025-11-27 19:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: abce0ce0-bd74-5873-a784-b93165797942 with identifier: 117550449
2025-11-27 19:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: abce0ce0-bd74-5873-a784-b93165797942 with identifier: 117550449
2025-11-27 19:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: abce0ce0-bd74-5873-a784-b93165797942 with identifier: 117550449 to the API
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HN70XOS/2025-11-27/image/23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'abce0ce0-bd74-5873-a784-b93165797942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HN70XOS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550449',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 47310,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29096,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4a8a3ca0-e3e9-4c20-bb48-fb84c7a89f56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30632,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/38c5b225-9f96-4e83-a5e7-e17b15aba106_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28226,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/f878122e-e610-494d-87bc-bfa884fa7687_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27422,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/b568095a-3355-4973-98f0-2958a93d0608_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49135,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/23edd6b1-4707-4814-889b-ad96f3340e92_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47004,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/9952690e-2cc9-43b2-b0c7-d5260271719b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47213,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/54d87490-370d-441b-9853-5ce4e101e9e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69211,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/0c3f637f-fd81-47c8-ab0e-80373fa08f6e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43457,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/7e7a2fb7-bdd7-4778-a386-5349838df8f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43814,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/4b8526cd-7bc0-469c-aaf4-188343604a07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abce0ce0-bd74-5873-a784-b93165797942/abce0ce0-bd74-5873-a784-b93165797942_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37420,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN70XOS/2025-11-27/image/02dd50ff-3a3e-48f5-b803-f804687f9ac2_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-06',
 'seller_name': 'UKCGR',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d SE 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '116d SE 5dr Step Auto',
 'vin': None,
 'year': 2020}
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550449%27 HTTP/1.1" 200 None
2025-11-27 19:06:09 [astonbarclay.gb] INFO: Saving data for 117550449: {'created_time': 1764270369.950309, 'last_price_update_time': 1764270369.95032}
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550449') HTTP/1.1" 204 0
2025-11-27 19:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d46d690>
2025-11-27 19:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9978d0>
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fecaad0>
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLO22KXH%252F2025-11-06%252Fimage%252F6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf
2025-11-27 19:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf, skipping ID generation
2025-11-27 19:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with scrape type 1
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf from tracking dictionaries
2025-11-27 19:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf sending to next pipeline
2025-11-27 19:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf, identifier: 114344014
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eae98d0>
2025-11-27 19:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252Ff02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue)
2025-11-27 19:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014
2025-11-27 19:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014
2025-11-27 19:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014 to the API
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '2c4a6f82-facb-5dea-9ec4-1f3252c9deaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO22KXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114344014',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '3008 DIESEL ESTATE',
 'odometer': 27677,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32930,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39596,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35988,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38291,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34482,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46356,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46968,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46113,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c4a6f82-facb-5dea-9ec4-1f3252c9deaf/2c4a6f82-facb-5dea-9ec4-1f3252c9deaf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 3008 DIESEL ESTATE 1.5 BlueHDi GT Premium 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi GT Premium 5dr EAT8',
 'vin': None,
 'year': 2022}
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114344014%27 HTTP/1.1" 200 None
2025-11-27 19:06:11 [astonbarclay.gb] INFO: Saving data for 114344014: {'created_time': 1764270371.412233, 'last_price_update_time': 1764270371.412242, 'auction_closing_time': 1765792800.0}
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114344014') HTTP/1.1" 204 0
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd002d0>
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdcad10>
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252F4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue)
2025-11-27 19:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0c8c90>
2025-11-27 19:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252Fe4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb75490>
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO74UMU%252F2025-11-27%252Fimage%252Fa1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e
2025-11-27 19:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e, skipping ID generation
2025-11-27 19:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e with scrape type 1
2025-11-27 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e from tracking dictionaries
2025-11-27 19:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e sending to next pipeline
2025-11-27 19:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e, identifier: 117552056
2025-11-27 19:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue)
2025-11-27 19:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e with identifier: 117552056
2025-11-27 19:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e with identifier: 117552056
2025-11-27 19:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 9, 'seller_name': 'ukcgr', 'price_includes_vat': False, 'title': 'renault scenic e-tech electric estate 160kw techno 87kwh long range 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'scenic e-tech electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4332, 'odometer_reading_unit': 'mi', 'registration_date': '2024-09-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117552056', 'expiration_date': None, 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '160kw techno 87kwh long range 5dr auto', 'license_plate': 'eo74umu', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41980}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38769}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50424}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47453}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41904}], 'current_year_diff': 1, 'age_in_months': 14, 'make_model': 'renault scenic e-tech electric estate', 'sanitized_make': 'renault', 'odometer_in_km': 6971} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'eo74umu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117552056',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'renault',
     'make_model': 'renault scenic e-tech electric estate',
     'model': 'scenic e-tech electric estate',
     'odometer': 4332,
     'odometer_in_km': 6971,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34913,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41980,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31595,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38769,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40758,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50424,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42820,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47453,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41904,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-09-12',
     'sanitized_make': 'renault',
     'seller_name': 'ukcgr',
     'title': 'renault scenic e-tech electric estate 160kw techno 87kwh '
              'long range 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw techno 87kwh long range 5dr auto',
     'vin': None,
     'year': 2024}
2025-11-27 19:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e spider: astonbarclay.gb
2025-11-27 19:06:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 9, 'seller_name': 'ukcgr', 'price_includes_vat': False, 'title': 'renault scenic e-tech electric estate 160kw techno 87kwh long range 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'scenic e-tech electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4332, 'odometer_reading_unit': 'mi', 'registration_date': '2024-09-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117552056', 'expiration_date': None, 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '160kw techno 87kwh long range 5dr auto', 'license_plate': 'eo74umu', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41980}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31595}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38769}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50424}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47453}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41904}], 'current_year_diff': 1, 'age_in_months': 14, 'make_model': 'renault scenic e-tech electric estate', 'sanitized_make': 'renault', 'odometer_in_km': 6971} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 14,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'eo74umu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117552056',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'renault',
     'make_model': 'renault scenic e-tech electric estate',
     'model': 'scenic e-tech electric estate',
     'odometer': 4332,
     'odometer_in_km': 6971,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34913,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41980,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31595,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38769,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40758,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50424,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42820,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47453,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41904,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-09-12',
     'sanitized_make': 'renault',
     'seller_name': 'ukcgr',
     'title': 'renault scenic e-tech electric estate 160kw techno 87kwh '
              'long range 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw techno 87kwh long range 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': '4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO74UMU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117552056',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'SCENIC E-TECH ELECTRIC ESTATE',
 'odometer': 4332,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34913,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/696adc6f-0c3a-43e5-b9d6-e18887a4fee4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41980,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/5b6463ea-d20e-404d-8dfe-e52e91629ebe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31595,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/996cc14d-711a-4cd1-9525-5d3dc5817f98_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38769,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b3e133b8-7f86-40e4-a2ff-91b97aeb2dc5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40758,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/b9f0c30f-03ca-447e-a10a-f18d7ba2a7d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50424,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/2b87e452-31f3-475d-9eff-b70786c1c141_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42820,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/1c96471f-b2d1-4e91-a682-c88b9053471e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47453,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/a1b51aa1-80d6-415b-9fbc-067e514f140d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e/4ca0624c-4ca8-5d7d-a7a9-931d7de4ed7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41904,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO74UMU/2025-11-27/image/9d4ea57a-ab99-4ebc-b220-f1d931083f69_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-12',
 'seller_name': 'UKCGR',
 'title': 'RENAULT SCENIC E-TECH ELECTRIC ESTATE 160kW Techno 87kWh Long Range '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '160kW Techno 87kWh Long Range 5dr Auto',
 'vin': None,
 'year': 2024}
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552056%27 HTTP/1.1" 200 None
2025-11-27 19:06:12 [astonbarclay.gb] INFO: Saving data for 117552056: {'created_time': 1764270372.774674, 'last_price_update_time': 1764270372.774684}
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117552056') HTTP/1.1" 204 0
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eaf4e10>
2025-11-27 19:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGD21LPJ%252F2025-11-27%252Fimage%252Fad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/ad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e52dead7-8e3d-5a7c-bf29-acca1f468abb
2025-11-27 19:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e52dead7-8e3d-5a7c-bf29-acca1f468abb, skipping ID generation
2025-11-27 19:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e52dead7-8e3d-5a7c-bf29-acca1f468abb with scrape type 1
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e52dead7-8e3d-5a7c-bf29-acca1f468abb from tracking dictionaries
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e52dead7-8e3d-5a7c-bf29-acca1f468abb sending to next pipeline
2025-11-27 19:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e52dead7-8e3d-5a7c-bf29-acca1f468abb, identifier: 117553434
2025-11-27 19:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1c690>
2025-11-27 19:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX19ZNK%252F2025-11-27%252Fimage%252F304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85
2025-11-27 19:06:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85, skipping ID generation
2025-11-27 19:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with scrape type 1
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 from tracking dictionaries
2025-11-27 19:06:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 sending to next pipeline
2025-11-27 19:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85, identifier: 117550696
2025-11-27 19:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EU22UWP/2025-11-27/image/af9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117536984?view=catalogue)
2025-11-27 19:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e52dead7-8e3d-5a7c-bf29-acca1f468abb with identifier: 117553434
2025-11-27 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e52dead7-8e3d-5a7c-bf29-acca1f468abb with identifier: 117553434
2025-11-27 19:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e52dead7-8e3d-5a7c-bf29-acca1f468abb with identifier: 117553434 to the API
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/ad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'e52dead7-8e3d-5a7c-bf29-acca1f468abb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GD21LPJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117553434',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A4 DIESEL SALOON',
 'odometer': 64059,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34768,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/c06bad2d-32b9-4a6e-9bf5-624edf96989f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38211,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/5c42f4f3-e83d-4c6f-9176-50ffb30fc7ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36818,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/de0684b9-36e0-427c-9e31-ad51ae9216ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37206,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/ad8f8d4d-cb63-41fe-ba43-a0b478754782_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46347,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/686b0024-bd43-48dd-ba72-b64df4238d5e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43631,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/4d9b1ffa-f71b-4c24-bced-866555389f20_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48058,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/40a2e3f4-7602-4d0e-9918-8889b88bb6a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54722,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/1230379f-556a-4405-8bc4-acbe07602544_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49474,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/41220162-8a65-4393-8790-7fa2a427535b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52dead7-8e3d-5a7c-bf29-acca1f468abb/e52dead7-8e3d-5a7c-bf29-acca1f468abb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52219,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GD21LPJ/2025-11-27/image/8afbe19d-ab5c-4e6c-a2d1-0523d43afa94_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seller_name': 'UKCGR',
 'title': 'AUDI A4 DIESEL SALOON 35 TDI S Line 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TDI S Line 4dr S Tronic',
 'vin': None,
 'year': 2021}
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553434%27 HTTP/1.1" 200 None
2025-11-27 19:06:13 [astonbarclay.gb] INFO: Saving data for 117553434: {'created_time': 1764270373.820957, 'last_price_update_time': 1764270373.82097}
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117553434') HTTP/1.1" 204 0
2025-11-27 19:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696
2025-11-27 19:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696
2025-11-27 19:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46b6a300-66a4-57b9-9cf6-1e3aefd40f85 with identifier: 117550696 to the API
2025-11-27 19:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '46b6a300-66a4-57b9-9cf6-1e3aefd40f85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX19ZNK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550696',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 25705,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31250,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/dbc723d2-8fdf-4ef6-ad40-10a76ce6b20e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35676,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/997262ef-83c8-49a0-8983-0d04db16ca14_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30575,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/b60b8fd2-681c-4eff-91ed-02f3ddc37257_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33968,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/304b74c5-6df5-4203-8e39-04671df9e2fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45917,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/34d9e36a-0a9e-459b-b7c4-65c7ede650c5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40452,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/63cda6f6-a44c-47e4-93f4-44ed7f8bc145_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34543,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/6f80eb86-6d3c-4f37-ab79-8767fd72693e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73369,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/f02372d8-b672-4b6c-9fee-820f37a4dfa8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27528,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/970d81e7-c299-43ee-8234-126d9c88da9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46b6a300-66a4-57b9-9cf6-1e3aefd40f85/46b6a300-66a4-57b9-9cf6-1e3aefd40f85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41064,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX19ZNK/2025-11-27/image/d809a779-7294-400b-bf1e-ecd1cd571f49_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': 'UKCGR',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 140 ST-Line 3dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 140 ST-Line 3dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550696%27 HTTP/1.1" 200 None
2025-11-27 19:06:14 [astonbarclay.gb] INFO: Saving data for 117550696: {'created_time': 1764270374.304636, 'last_price_update_time': 1764270374.304653}
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550696') HTTP/1.1" 204 0
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e95e810>
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea7a1d0>
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252F7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd58950>
2025-11-27 19:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d132c90>
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF22XOZ%252F2025-10-22%252Fimage%252F192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95151d0a-5a69-529c-babd-8bdf3c4858ea
2025-11-27 19:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95151d0a-5a69-529c-babd-8bdf3c4858ea, skipping ID generation
2025-11-27 19:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95151d0a-5a69-529c-babd-8bdf3c4858ea with scrape type 1
2025-11-27 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 95151d0a-5a69-529c-babd-8bdf3c4858ea from tracking dictionaries
2025-11-27 19:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95151d0a-5a69-529c-babd-8bdf3c4858ea sending to next pipeline
2025-11-27 19:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 95151d0a-5a69-529c-babd-8bdf3c4858ea, identifier: 116500039
2025-11-27 19:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK72NRE/2025-11-27/image/dedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541699?view=catalogue)
2025-11-27 19:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039
2025-11-27 19:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039
2025-11-27 19:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039 to the API
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '95151d0a-5a69-529c-babd-8bdf3c4858ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF22XOZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116500039',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 19583,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32253,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33709,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32817,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30863,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33097,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89114,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86183,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50994,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95151d0a-5a69-529c-babd-8bdf3c4858ea/95151d0a-5a69-529c-babd-8bdf3c4858ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37849,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-23',
 'seller_name': 'Motability Operations',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 EcoBlue 190 Titanium Edition 5dr Auto '
          'AWD',
 'transmission': 'automatic',
 'trim': '2.0 EcoBlue 190 Titanium Edition 5dr Auto AWD',
 'vin': None,
 'year': 2022}
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116500039%27 HTTP/1.1" 200 None
2025-11-27 19:06:15 [astonbarclay.gb] INFO: Saving data for 116500039: {'created_time': 1764270375.740209, 'last_price_update_time': 1764270375.740219, 'auction_closing_time': 1765792800.0}
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116500039') HTTP/1.1" 204 0
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80c410>
2025-11-27 19:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEY74TWG%252F2025-10-29%252Fimage%252Fe991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9
2025-11-27 19:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9, skipping ID generation
2025-11-27 19:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with scrape type 1
2025-11-27 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 from tracking dictionaries
2025-11-27 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 sending to next pipeline
2025-11-27 19:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9, identifier: 116504950
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec268d0>
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Fc27f71ef-da61-415d-981f-574884694df2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570270?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950
2025-11-27 19:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950
2025-11-27 19:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950 to the API
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '46bdee26-3d6d-54e7-b2d0-dba8628bd6d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY74TWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116504950',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 7520,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42945,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44834,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39817,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44106,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35240,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41197,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54046,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48023,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41110,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46bdee26-3d6d-54e7-b2d0-dba8628bd6d9/46bdee26-3d6d-54e7-b2d0-dba8628bd6d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33022,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Trophy 5dr',
 'transmission': 'manual',
 'trim': '1.5 T-GDI Trophy 5dr',
 'vin': None,
 'year': 2024}
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116504950%27 HTTP/1.1" 200 None
2025-11-27 19:06:16 [astonbarclay.gb] INFO: Saving data for 116504950: {'created_time': 1764270376.750561, 'last_price_update_time': 1764270376.750574, 'auction_closing_time': 1765792800.0}
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116504950') HTTP/1.1" 204 0
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e831810>
2025-11-27 19:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL74UKJ%252F2025-10-29%252Fimage%252Faeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433
2025-11-27 19:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2aa95ee2-75cc-5bf0-aa48-be00bab61433, skipping ID generation
2025-11-27 19:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with scrape type 1
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2aa95ee2-75cc-5bf0-aa48-be00bab61433 from tracking dictionaries
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433 sending to next pipeline
2025-11-27 19:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2aa95ee2-75cc-5bf0-aa48-be00bab61433, identifier: 116557093
2025-11-27 19:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117567350?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093
2025-11-27 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093
2025-11-27 19:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093 to the API
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2aa95ee2-75cc-5bf0-aa48-be00bab61433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GL74UKJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116557093',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 8612,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39415,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45610,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40147,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43349,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44543,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46724,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58653,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55776,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54002,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2aa95ee2-75cc-5bf0-aa48-be00bab61433/2aa95ee2-75cc-5bf0-aa48-be00bab61433_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52824,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-18',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic',
 'vin': None,
 'year': 2024}
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116557093%27 HTTP/1.1" 200 None
2025-11-27 19:06:17 [astonbarclay.gb] INFO: Saving data for 116557093: {'created_time': 1764270377.49359, 'last_price_update_time': 1764270377.4936, 'auction_closing_time': 1765792800.0}
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116557093') HTTP/1.1" 204 0
2025-11-27 19:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e832990>
2025-11-27 19:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEU22UWP%252F2025-11-27%252Fimage%252Faf9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EU22UWP/2025-11-27/image/af9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b8e66b0-9b65-5140-b305-36d2d317d861
2025-11-27 19:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b8e66b0-9b65-5140-b305-36d2d317d861, skipping ID generation
2025-11-27 19:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b8e66b0-9b65-5140-b305-36d2d317d861 with scrape type 1
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3b8e66b0-9b65-5140-b305-36d2d317d861 from tracking dictionaries
2025-11-27 19:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b8e66b0-9b65-5140-b305-36d2d317d861 sending to next pipeline
2025-11-27 19:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3b8e66b0-9b65-5140-b305-36d2d317d861, identifier: 117536984
2025-11-27 19:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3b8e66b0-9b65-5140-b305-36d2d317d861 with identifier: 117536984
2025-11-27 19:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3b8e66b0-9b65-5140-b305-36d2d317d861 with identifier: 117536984
2025-11-27 19:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3b8e66b0-9b65-5140-b305-36d2d317d861 with identifier: 117536984 to the API
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EU22UWP/2025-11-27/image/af9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '3b8e66b0-9b65-5140-b305-36d2d317d861',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EU22UWP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117536984',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 32700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34409,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/af9bdd0e-1673-4da5-be86-096db72077b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35362,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/b6ed02cf-951f-4af6-b334-aab9aed3c409_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34037,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/0d09047b-53c9-4c7e-9832-2eb14b599179_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35646,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/884f9f32-7c9c-4993-966f-1e03d86cdbc9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39977,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/81b74c9a-9be7-4287-95f9-56bd4dc0bfa8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51882,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/5581ddf8-48c1-419b-91ee-5cdd54b7633e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55423,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/eb3fad8b-9841-4d75-bff9-8b2e7cdf7962_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39014,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/1a8e8c5c-c77c-4dfc-862b-7f5ea6c45a13_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47751,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/52122438-e67e-47d1-a436-01fd8c885605_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b8e66b0-9b65-5140-b305-36d2d317d861/3b8e66b0-9b65-5140-b305-36d2d317d861_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48713,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EU22UWP/2025-11-27/image/2497bc29-7ea0-4384-b58c-58cdfb4d4cc1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD KUGA DIESEL ESTATE 1.5 EcoBlue Titanium Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 EcoBlue Titanium Edition 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536984%27 HTTP/1.1" 200 None
2025-11-27 19:06:18 [astonbarclay.gb] INFO: Saving data for 117536984: {'created_time': 1764270378.293454, 'last_price_update_time': 1764270378.293464, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117536984') HTTP/1.1" 204 0
2025-11-27 19:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c6ebd10>
2025-11-27 19:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK72NRE%252F2025-11-27%252Fimage%252Fdedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK72NRE/2025-11-27/image/dedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2
2025-11-27 19:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f143cc3b-0a66-5fe5-9c61-9b40590af7d2, skipping ID generation
2025-11-27 19:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2 with scrape type 1
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f143cc3b-0a66-5fe5-9c61-9b40590af7d2 from tracking dictionaries
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f143cc3b-0a66-5fe5-9c61-9b40590af7d2 sending to next pipeline
2025-11-27 19:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f143cc3b-0a66-5fe5-9c61-9b40590af7d2, identifier: 117541699
2025-11-27 19:06:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549984, 'registration': 'EP19EJE', 'account': 'WBA001', 'make': 'MAZDA', 'model': 'CX-3 HATCHBACK SPECIAL EDITION', 'derivative': '2.0 GT Sport Nav + 5dr Auto', 'mileage': 21406, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EP19EJE/2025-11-27/image/585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/ca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/23acd02e-db28-490c-b235-acb23df75767_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 11k 14k 17k 19k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1a5b86b2-b477-4f12-be67-ebc18eaf7a92.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549984, 'registration': 'EP19EJE', 'account': 'WBA001', 'make': 'MAZDA', 'model': 'CX-3 HATCHBACK SPECIAL EDITION', 'derivative': '2.0 GT Sport Nav + 5dr Auto', 'mileage': 21406, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EP19EJE/2025-11-27/image/585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/ca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/23acd02e-db28-490c-b235-acb23df75767_removebg.jpg?w=600', 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY - VOSA STATES 11k 14k 17k 19k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1a5b86b2-b477-4f12-be67-ebc18eaf7a92.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d01f3068-611b-5e9f-a42d-09c4b4559cf1 with identifier: 117549984
2025-11-27 19:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d01f3068-611b-5e9f-a42d-09c4b4559cf1 with scrape type 1
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117552007, 'registration': 'EF69YKM', 'account': 'WBA001', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Business Edition Nav 5dr Auto', 'mileage': 44163, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF69YKM/2025-11-27/image/dc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/d7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/de211143-d947-4b00-822e-37f05bb444f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/21-2k, 01/22-6k 12/22-10k', 'remarks': 'VOSA STATES 10k 22k 31k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1af68acf-20c8-46bf-9ca5-807c77b792c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117552007, 'registration': 'EF69YKM', 'account': 'WBA001', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Business Edition Nav 5dr Auto', 'mileage': 44163, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EF69YKM/2025-11-27/image/dc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/d7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/de211143-d947-4b00-822e-37f05bb444f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/21-2k, 01/22-6k 12/22-10k', 'remarks': 'VOSA STATES 10k 22k 31k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1af68acf-20c8-46bf-9ca5-807c77b792c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12144cb7-c989-5107-a7c5-1c061d99e408 with identifier: 117552007
2025-11-27 19:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12144cb7-c989-5107-a7c5-1c061d99e408 with scrape type 1
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fdc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/dc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f143cc3b-0a66-5fe5-9c61-9b40590af7d2 with identifier: 117541699
2025-11-27 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f143cc3b-0a66-5fe5-9c61-9b40590af7d2 with identifier: 117541699
2025-11-27 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149945 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149945
2025-11-27 19:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: f143cc3b-0a66-5fe5-9c61-9b40590af7d2 spider: astonbarclay.gb
2025-11-27 19:06:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f143cc3b-0a66-5fe5-9c61-9b40590af7d2 due to rule: high_mileage_for_make.json, error: 149945 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149945
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'f143cc3b-0a66-5fe5-9c61-9b40590af7d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK72NRE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117541699',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'ARKANA ESTATE',
 'odometer': 93172,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/dedcd2bd-fff0-47a8-8050-c6b90ee09c8b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/86f05aac-6562-472d-8331-fd62ad316a46_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38274,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/38500b73-fffd-4442-87db-8b2ec6e3648f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37611,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/b5bb8c0c-7bd8-4e8a-8543-8adeacbdacca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42739,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/1cfabe01-2883-4124-bf97-97a83f6cd171_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44430,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c0a49001-7f30-4c32-aa5c-8cd3c9bb41a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53413,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/8c03fa9b-f581-459b-9e52-1c7318ffeeb7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52035,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/66e80ca1-7600-42a5-9ce9-7f6a6ff0e9b1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f143cc3b-0a66-5fe5-9c61-9b40590af7d2/f143cc3b-0a66-5fe5-9c61-9b40590af7d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47147,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK72NRE/2025-11-27/image/c4794d05-b802-4c54-9835-28ed7cf0f756_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seller_name': 'UKCGR - Premium',
 'title': 'RENAULT ARKANA ESTATE 1.6 E-Tech full hybrid 145 Evolution 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-Tech full hybrid 145 Evolution 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541699%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Saving data for 117541699: {'created_time': 1764270378.999836, 'last_price_update_time': 1764270378.999846, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117541699') HTTP/1.1" 204 0
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549930, 'registration': 'DU71NZB', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Tekna 5dr', 'mileage': 22703, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2021-11-25', 'fuel': 'Petrol', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU71NZB/2025-11-27/image/4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/c97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/d126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 18K 22K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8c2d9b18-04e8-4adf-8553-2c5795822b15.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549930, 'registration': 'DU71NZB', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 Tekna 5dr', 'mileage': 22703, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2021-11-25', 'fuel': 'Petrol', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU71NZB/2025-11-27/image/4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/c97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/d126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 18K 22K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8c2d9b18-04e8-4adf-8553-2c5795822b15.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e2776a-38c8-5d6b-985b-f0add81eff31 with identifier: 117549930
2025-11-27 19:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e2776a-38c8-5d6b-985b-f0add81eff31 with scrape type 1
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550047, 'registration': 'RO67OER', 'account': 'WBA001', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE 4dr Step Auto', 'mileage': 88499, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-01-18', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/RO67OER/2025-11-27/image/63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/f9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/e79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/dcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/b8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/22-52k (Oil Service)', 'remarks': 'Rear Entertainment Screens (Remote and Headphones in the office) - SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93872261-4255-4e4c-988c-ae8b13fb5241.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550047, 'registration': 'RO67OER', 'account': 'WBA001', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE 4dr Step Auto', 'mileage': 88499, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-01-18', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/RO67OER/2025-11-27/image/63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/f9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/e79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/dcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/b8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 01/22-52k (Oil Service)', 'remarks': 'Rear Entertainment Screens (Remote and Headphones in the office) - SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93872261-4255-4e4c-988c-ae8b13fb5241.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b275b539-f448-5479-809d-545bcf70c126 with identifier: 117550047
2025-11-27 19:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b275b539-f448-5479-809d-545bcf70c126 with scrape type 1
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570270, 'registration': 'FG71GYH', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'ZOE HATCHBACK SPECIAL EDITION', 'derivative': '100kW Riviera Limited Edn R135 50kWh RC 5dr Auto', 'mileage': 52220, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-10-09', 'fuel': 'Electric', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 38K 51K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4053069-0aed-4290-bccb-f01c1f9ff4a3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570270, 'registration': 'FG71GYH', 'account': 'RCI014', 'make': 'RENAULT', 'model': 'ZOE HATCHBACK SPECIAL EDITION', 'derivative': '100kW Riviera Limited Edn R135 50kWh RC 5dr Auto', 'mileage': 52220, 'mileageWarranty': False, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-10-09', 'fuel': 'Electric', 'motExpiry': '2026-10-22', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 38K 51K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4053069-0aed-4290-bccb-f01c1f9ff4a3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0 with identifier: 117570270
2025-11-27 19:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0 with scrape type 1
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0
2025-11-27 19:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0, identifier: 117570270
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0 with identifier: 117570270
2025-11-27 19:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0 with identifier: 117570270
2025-11-27 19:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'renault zoe hatchback special edition 100kw riviera limited edn r135 50kwh rc 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'zoe hatchback special edition', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 52220, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570270', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw riviera limited edn r135 50kwh rc 5dr auto', 'license_plate': 'fg71gyh', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '13e0c04b-a8ef-512e-b291-0cd6b98cb1b0', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'renault zoe hatchback special edition', 'sanitized_make': 'renault', 'odometer_in_km': 84039} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '13e0c04b-a8ef-512e-b291-0cd6b98cb1b0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fg71gyh',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570270',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'renault',
     'make_model': 'renault zoe hatchback special edition',
     'model': 'zoe hatchback special edition',
     'odometer': 52220,
     'odometer_in_km': 84039,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-09',
     'sanitized_make': 'renault',
     'seller_name': None,
     'title': 'renault zoe hatchback special edition 100kw riviera limited '
              'edn r135 50kwh rc 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw riviera limited edn r135 50kwh rc 5dr auto',
     'vin': None,
     'year': 2021}
2025-11-27 19:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0 spider: astonbarclay.gb
2025-11-27 19:06:19 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 13e0c04b-a8ef-512e-b291-0cd6b98cb1b0 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'renault zoe hatchback special edition 100kw riviera limited edn r135 50kwh rc 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'zoe hatchback special edition', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 52220, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570270', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '100kw riviera limited edn r135 50kwh rc 5dr auto', 'license_plate': 'fg71gyh', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '13e0c04b-a8ef-512e-b291-0cd6b98cb1b0', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'renault zoe hatchback special edition', 'sanitized_make': 'renault', 'odometer_in_km': 84039} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '13e0c04b-a8ef-512e-b291-0cd6b98cb1b0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fg71gyh',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570270',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'renault',
     'make_model': 'renault zoe hatchback special edition',
     'model': 'zoe hatchback special edition',
     'odometer': 52220,
     'odometer_in_km': 84039,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-09',
     'sanitized_make': 'renault',
     'seller_name': None,
     'title': 'renault zoe hatchback special edition 100kw riviera limited '
              'edn r135 50kwh rc 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw riviera limited edn r135 50kwh rc 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': '13e0c04b-a8ef-512e-b291-0cd6b98cb1b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FG71GYH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570270',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'RENAULT',
 'model': 'ZOE HATCHBACK SPECIAL EDITION',
 'odometer': 52220,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-09',
 'seller_name': None,
 'title': 'RENAULT ZOE HATCHBACK SPECIAL EDITION 100kW Riviera Limited Edn '
          'R135 50kWh RC 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Riviera Limited Edn R135 50kWh RC 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570270%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Saving data for 117570270: {'created_time': 1764270379.395317, 'last_price_update_time': 1764270379.395327}
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570270') HTTP/1.1" 204 0
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117567350, 'registration': 'BM19OVT', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T N-Connecta 5dr', 'mileage': 23782, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-06-21', 'fuel': 'Petrol', 'motExpiry': '2026-01-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 11K 15K 18K 21K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33f2de54-4116-4295-a9c7-ece518935ed2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117567350, 'registration': 'BM19OVT', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T N-Connecta 5dr', 'mileage': 23782, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-06-21', 'fuel': 'Petrol', 'motExpiry': '2026-01-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 11K 15K 18K 21K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33f2de54-4116-4295-a9c7-ece518935ed2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350
2025-11-27 19:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with scrape type 1
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360
2025-11-27 19:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360, identifier: 117567350
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252Fc97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/c97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350
2025-11-27 19:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350
2025-11-27 19:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350 to the API
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2772cf6b33-bfe0-56fd-8273-2d0c6dd7c360%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:06:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117567350?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '72cf6b33-bfe0-56fd-8273-2d0c6dd7c360',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BM19OVT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117567350',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 23782,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-21',
 'seller_name': None,
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567350%27 HTTP/1.1" 200 None
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Saving data for 117567350: {'created_time': 1764270379.836642, 'last_price_update_time': 1764270379.836655}
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117567350') HTTP/1.1" 204 0
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117512026, 'registration': 'EO20ULG', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line Executive 5dr Auto', 'mileage': 75762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/4ba9e658-7d63-453c-9810-15029dac65d2.jpg?w=600', 'https://abimg002.imgix.net/f840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg?w=600', 'https://abimg002.imgix.net/3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg?w=600', 'https://abimg002.imgix.net/16f08e30-dccd-4430-b1d8-539579934dff.jpg?w=600', 'https://abimg002.imgix.net/9129a528-6888-4849-9486-8328c2caf3e7.jpg?w=600', 'https://abimg002.imgix.net/5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg?w=600', 'https://abimg002.imgix.net/5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg?w=600', 'https://abimg002.imgix.net/67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3a28bc0-e9f8-47c9-aad2-abeec1657e00.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117512026, 'registration': 'EO20ULG', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A200 AMG Line Executive 5dr Auto', 'mileage': 75762, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/4ba9e658-7d63-453c-9810-15029dac65d2.jpg?w=600', 'https://abimg002.imgix.net/f840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg?w=600', 'https://abimg002.imgix.net/3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg?w=600', 'https://abimg002.imgix.net/16f08e30-dccd-4430-b1d8-539579934dff.jpg?w=600', 'https://abimg002.imgix.net/9129a528-6888-4849-9486-8328c2caf3e7.jpg?w=600', 'https://abimg002.imgix.net/5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg?w=600', 'https://abimg002.imgix.net/5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg?w=600', 'https://abimg002.imgix.net/67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3a28bc0-e9f8-47c9-aad2-abeec1657e00.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89148e1c-73e2-5710-9d51-7e6fb0de55e6 with identifier: 117512026
2025-11-27 19:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6 with scrape type 1
2025-11-27 19:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4ba9e658-7d63-453c-9810-15029dac65d2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4ba9e658-7d63-453c-9810-15029dac65d2.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550785, 'registration': 'CP73FYW', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr DCT', 'mileage': 4845, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29120e4f-1602-4cdd-912d-0867402ab334.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550785, 'registration': 'CP73FYW', 'account': 'RCI014', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr DCT', 'mileage': 4845, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 187}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29120e4f-1602-4cdd-912d-0867402ab334.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785
2025-11-27 19:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf408e58-6583-5936-b8d5-dfdd53969545 with scrape type 1
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fb72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fd7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/d7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Fd73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fb26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F16f08e30-dccd-4430-b1d8-539579934dff.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/16f08e30-dccd-4430-b1d8-539579934dff.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Fc769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252Fca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/ca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Ff9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/f9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9129a528-6888-4849-9486-8328c2caf3e7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9129a528-6888-4849-9486-8328c2caf3e7.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Ffefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252Fd126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/d126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Ff9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F23acd02e-db28-490c-b235-acb23df75767_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/23acd02e-db28-490c-b235-acb23df75767_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fde211143-d947-4b00-822e-37f05bb444f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/de211143-d947-4b00-822e-37f05bb444f7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Fe79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/e79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Fdcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/dcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Fb8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/b8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117331028, 'registration': 'WN18BWW', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C220d AMG Line 4dr 9G-Tronic', 'mileage': 89808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-31', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/a0109d46-5560-407b-893a-35e8589b8ce4.jpg?w=600', 'https://abimg002.imgix.net/4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg?w=600', 'https://abimg002.imgix.net/5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg?w=600', 'https://abimg002.imgix.net/0d3f5b83-857e-4921-885d-12eca9582feb.jpg?w=600', 'https://abimg002.imgix.net/97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg?w=600', 'https://abimg002.imgix.net/b5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg?w=600', 'https://abimg002.imgix.net/1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg?w=600', 'https://abimg002.imgix.net/4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg?w=600', 'https://abimg002.imgix.net/d8bab155-1a13-436f-b78a-0ecb27a7615f.jpg?w=600', 'https://abimg002.imgix.net/847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg?w=600', 'https://abimg002.imgix.net/12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg?w=600', 'https://abimg002.imgix.net/649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg?w=600', 'https://abimg002.imgix.net/74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg?w=600', 'https://abimg002.imgix.net/303aff60-32c9-4c38-ada0-29a51e96ed55.jpg?w=600', 'https://abimg002.imgix.net/5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg?w=600', 'https://abimg002.imgix.net/24754160-8246-4b74-8090-fa38ebe16722.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f511dff5-005e-4df1-9227-b99910dbb934.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117331028, 'registration': 'WN18BWW', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C220d AMG Line 4dr 9G-Tronic', 'mileage': 89808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-31', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/a0109d46-5560-407b-893a-35e8589b8ce4.jpg?w=600', 'https://abimg002.imgix.net/4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg?w=600', 'https://abimg002.imgix.net/5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg?w=600', 'https://abimg002.imgix.net/0d3f5b83-857e-4921-885d-12eca9582feb.jpg?w=600', 'https://abimg002.imgix.net/97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg?w=600', 'https://abimg002.imgix.net/b5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg?w=600', 'https://abimg002.imgix.net/1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg?w=600', 'https://abimg002.imgix.net/4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg?w=600', 'https://abimg002.imgix.net/d8bab155-1a13-436f-b78a-0ecb27a7615f.jpg?w=600', 'https://abimg002.imgix.net/847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg?w=600', 'https://abimg002.imgix.net/12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg?w=600', 'https://abimg002.imgix.net/649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg?w=600', 'https://abimg002.imgix.net/74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg?w=600', 'https://abimg002.imgix.net/303aff60-32c9-4c38-ada0-29a51e96ed55.jpg?w=600', 'https://abimg002.imgix.net/5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg?w=600', 'https://abimg002.imgix.net/24754160-8246-4b74-8090-fa38ebe16722.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f511dff5-005e-4df1-9227-b99910dbb934.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b15a9f4-4b46-57c0-a055-8d89496d1557 with identifier: 117331028
2025-11-27 19:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b15a9f4-4b46-57c0-a055-8d89496d1557 with scrape type 1
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa0109d46-5560-407b-893a-35e8589b8ce4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a0109d46-5560-407b-893a-35e8589b8ce4.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0d3f5b83-857e-4921-885d-12eca9582feb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0d3f5b83-857e-4921-885d-12eca9582feb.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb74e50>
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_13.jpg HTTP/1.1" 201 0
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117061078?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576508?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d0913d0>
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_12.jpg HTTP/1.1" 201 0
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576566?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117514787?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd8bab155-1a13-436f-b78a-0ecb27a7615f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d8bab155-1a13-436f-b78a-0ecb27a7615f.jpg?w=600 not downloaded yet
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:06:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117061078, 'registration': 'EY68GZL', 'account': 'ESS030', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 96982, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2025-11-14', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY68GZL/2025-11-12/image/285b45eb-f623-496e-a4cb-1f99ac452be0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/6a880cee-0a08-4c1e-919e-bbf56bf05248_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/a9f03f72-c44e-4602-b3bb-ef15ca3603ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/86d36f31-6707-4c0e-bc4f-94c2f8888747_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/8a5e996c-8592-48b5-9000-d7f97ae90ac5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/e3d706ca-9a56-494b-91ca-8424270e5e4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/d3b44d8e-cf57-4dae-adde-3791b6c5b532_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/737fbd4f-65af-421d-8f8f-be2ddb361af2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/fad89fc1-5786-4a3c-9947-807219ecea86_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 2/20 27K, 2/22 37K, 2/23 50K, 5/24 77K', 'remarks': 'VOSA STATES 35K, 47K, 68K, 85K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dda38be0-baf5-4335-919d-449deb8c0770.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117061078, 'registration': 'EY68GZL', 'account': 'ESS030', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 96982, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2025-11-14', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY68GZL/2025-11-12/image/285b45eb-f623-496e-a4cb-1f99ac452be0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/6a880cee-0a08-4c1e-919e-bbf56bf05248_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/a9f03f72-c44e-4602-b3bb-ef15ca3603ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/86d36f31-6707-4c0e-bc4f-94c2f8888747_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/8a5e996c-8592-48b5-9000-d7f97ae90ac5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/e3d706ca-9a56-494b-91ca-8424270e5e4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/d3b44d8e-cf57-4dae-adde-3791b6c5b532_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/737fbd4f-65af-421d-8f8f-be2ddb361af2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY68GZL/2025-11-12/image/fad89fc1-5786-4a3c-9947-807219ecea86_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 2/20 27K, 2/22 37K, 2/23 50K, 5/24 77K', 'remarks': 'VOSA STATES 35K, 47K, 68K, 85K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dda38be0-baf5-4335-919d-449deb8c0770.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19ffec9b-eaef-5c01-a23b-7e753aea89ca with identifier: 117061078
2025-11-27 19:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ffec9b-eaef-5c01-a23b-7e753aea89ca with scrape type 2
2025-11-27 19:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19ffec9b-eaef-5c01-a23b-7e753aea89ca with scrape type 2
2025-11-27 19:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 19ffec9b-eaef-5c01-a23b-7e753aea89ca, identifier: 117061078
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117541958, 'registration': 'KJ21NXT', 'account': 'WBA002', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.2 Dualjet 83 12V Hybrid SZ5 5dr', 'mileage': 22880, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-08-09', 'fuel': 'Petrol', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/c9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/e7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/cf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/d3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/22-3K 02/23-5K 04/24-8K 04/25-17K', 'remarks': 'VOSA STATES 8K 16K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1191013f-10f9-4738-a17b-7df43bf6151f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117541958, 'registration': 'KJ21NXT', 'account': 'WBA002', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.2 Dualjet 83 12V Hybrid SZ5 5dr', 'mileage': 22880, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-08-09', 'fuel': 'Petrol', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/c9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/e7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/cf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/d3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 07/22-3K 02/23-5K 04/24-8K 04/25-17K', 'remarks': 'VOSA STATES 8K 16K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1191013f-10f9-4738-a17b-7df43bf6151f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53def01d-cb77-57c1-93f7-66212e7eedff with identifier: 117541958
2025-11-27 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53def01d-cb77-57c1-93f7-66212e7eedff with scrape type 1
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fc9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/c9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117542051, 'registration': 'FP68XSJ', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'UP HATCHBACK SPECIAL EDS', 'derivative': '1.0 Up Beats 5dr', 'mileage': 19328, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-12-11', 'fuel': 'Petrol', 'motExpiry': '2026-12-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/21-12K 12/22-14K 12/24-17K 11/25-19K', 'remarks': 'VOSA STATES 14K 16K 17K 19K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/571c4744-bc97-4e71-8775-00e962cdbfec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117542051, 'registration': 'FP68XSJ', 'account': 'WBA002', 'make': 'VOLKSWAGEN', 'model': 'UP HATCHBACK SPECIAL EDS', 'derivative': '1.0 Up Beats 5dr', 'mileage': 19328, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-12-11', 'fuel': 'Petrol', 'motExpiry': '2026-12-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600', 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/21-12K 12/22-14K 12/24-17K 11/25-19K', 'remarks': 'VOSA STATES 14K 16K 17K 19K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 95, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/571c4744-bc97-4e71-8775-00e962cdbfec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051
2025-11-27 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f360f0-a557-5a39-ad4b-7c9f2412e678 with scrape type 1
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576508, 'registration': 'YN19NDA', 'account': 'GAT001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 176 Titanium Edition 5dr Auto', 'mileage': 19656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-07-06', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 208, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/526a3172-f4a0-4670-9001-b056da2b7f07.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576508, 'registration': 'YN19NDA', 'account': 'GAT001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 176 Titanium Edition 5dr Auto', 'mileage': 19656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-07-06', 'fuel': 'Petrol', 'motExpiry': '2026-05-22', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 208, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/526a3172-f4a0-4670-9001-b056da2b7f07.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27d17be3-f932-5b38-9769-dbddb7f646db with identifier: 117576508
2025-11-27 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d17be3-f932-5b38-9769-dbddb7f646db with scrape type 1
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 27d17be3-f932-5b38-9769-dbddb7f646db
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 27d17be3-f932-5b38-9769-dbddb7f646db
2025-11-27 19:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 27d17be3-f932-5b38-9769-dbddb7f646db, identifier: 117576508
2025-11-27 19:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 19ffec9b-eaef-5c01-a23b-7e753aea89ca with identifier: 117061078
2025-11-27 19:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 19ffec9b-eaef-5c01-a23b-7e753aea89ca with identifier: 117061078
2025-11-27 19:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156077 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156077
2025-11-27 19:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 19ffec9b-eaef-5c01-a23b-7e753aea89ca spider: astonbarclay.gb
2025-11-27 19:06:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 19ffec9b-eaef-5c01-a23b-7e753aea89ca due to rule: high_mileage_for_country.json, error: 156077 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156077
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '19ffec9b-eaef-5c01-a23b-7e753aea89ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY68GZL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117061078',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'ECOSPORT HATCHBACK',
 'odometer': 96982,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seller_name': 'SMC GROUP',
 'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061078%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Saving data for 117061078: {'auction_closing_time': 1764331200.0, 'created_time': 1762888174.132706, 'last_price_update_time': 1764270382.433843}
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117061078') HTTP/1.1" 204 0
2025-11-27 19:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 27d17be3-f932-5b38-9769-dbddb7f646db with identifier: 117576508
2025-11-27 19:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 27d17be3-f932-5b38-9769-dbddb7f646db with identifier: 117576508
2025-11-27 19:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 27d17be3-f932-5b38-9769-dbddb7f646db with identifier: 117576508 to the API
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2727d17be3-f932-5b38-9769-dbddb7f646db%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 27d17be3-f932-5b38-9769-dbddb7f646db: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:06:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576508?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '27d17be3-f932-5b38-9769-dbddb7f646db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YN19NDA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576508',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 19656,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-06',
 'seller_name': 'Gates Group',
 'title': 'FORD KUGA ESTATE 1.5 EcoBoost 176 Titanium Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 EcoBoost 176 Titanium Edition 5dr Auto',
 'vin': None,
 'year': 2019}
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576508%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Saving data for 117576508: {'created_time': 1764270382.758739, 'last_price_update_time': 1764270382.758748, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576508') HTTP/1.1" 204 0
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg?w=600 not downloaded yet
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fc28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117184599?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576566, 'registration': 'EX70LZD', 'account': 'GAT001', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 29199, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9cf8a60d-19fa-4b73-a680-d010ecdb7425.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576566, 'registration': 'EX70LZD', 'account': 'GAT001', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 29199, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9cf8a60d-19fa-4b73-a680-d010ecdb7425.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107c91f8-7531-5871-b5d9-7f329dff42d8 with identifier: 117576566
2025-11-27 19:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107c91f8-7531-5871-b5d9-7f329dff42d8 with scrape type 1
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 107c91f8-7531-5871-b5d9-7f329dff42d8
2025-11-27 19:06:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 107c91f8-7531-5871-b5d9-7f329dff42d8
2025-11-27 19:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 107c91f8-7531-5871-b5d9-7f329dff42d8, identifier: 117576566
2025-11-27 19:06:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117525337, 'registration': 'WO21ZXD', 'account': 'MER167', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 27944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-08-09', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-08-08', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg?w=600', 'https://abimg002.imgix.net/f875a153-826a-4b7e-954b-b0580899ac8e.jpg?w=600', 'https://abimg002.imgix.net/9750add4-32c9-40fc-954a-ac22ed10204c.jpg?w=600', 'https://abimg002.imgix.net/70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg?w=600', 'https://abimg002.imgix.net/85806a3d-8524-4474-bb7e-055a80a1c54c.jpg?w=600', 'https://abimg002.imgix.net/2ac23139-b44f-4e48-809b-8bfe483ed654.jpg?w=600', 'https://abimg002.imgix.net/b484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b207e6c9-f98d-4238-a494-bb8f5e41d20d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117525337, 'registration': 'WO21ZXD', 'account': 'MER167', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 27944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-08-09', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-08-08', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg?w=600', 'https://abimg002.imgix.net/f875a153-826a-4b7e-954b-b0580899ac8e.jpg?w=600', 'https://abimg002.imgix.net/9750add4-32c9-40fc-954a-ac22ed10204c.jpg?w=600', 'https://abimg002.imgix.net/70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg?w=600', 'https://abimg002.imgix.net/85806a3d-8524-4474-bb7e-055a80a1c54c.jpg?w=600', 'https://abimg002.imgix.net/2ac23139-b44f-4e48-809b-8bfe483ed654.jpg?w=600', 'https://abimg002.imgix.net/b484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b207e6c9-f98d-4238-a494-bb8f5e41d20d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a17989f4-9329-5f2d-ba8c-eac9bf646124 with identifier: 117525337
2025-11-27 19:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a17989f4-9329-5f2d-ba8c-eac9bf646124 with scrape type 1
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117514787, 'registration': 'EO16FCC', 'account': 'GAT002', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium X 5dr Powershift', 'mileage': 71347, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-21', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4156ce1b-34a2-4962-89d0-6f1a28083ae0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117514787, 'registration': 'EO16FCC', 'account': 'GAT002', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium X 5dr Powershift', 'mileage': 71347, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-21', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4156ce1b-34a2-4962-89d0-6f1a28083ae0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6295c9df-e6e7-5baa-8938-1b28314d8032 with identifier: 117514787
2025-11-27 19:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6295c9df-e6e7-5baa-8938-1b28314d8032 with scrape type 1
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 6295c9df-e6e7-5baa-8938-1b28314d8032
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 6295c9df-e6e7-5baa-8938-1b28314d8032
2025-11-27 19:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6295c9df-e6e7-5baa-8938-1b28314d8032, identifier: 117514787
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fc7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 107c91f8-7531-5871-b5d9-7f329dff42d8 with identifier: 117576566
2025-11-27 19:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 107c91f8-7531-5871-b5d9-7f329dff42d8 with identifier: 117576566
2025-11-27 19:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 107c91f8-7531-5871-b5d9-7f329dff42d8 with identifier: 117576566 to the API
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27107c91f8-7531-5871-b5d9-7f329dff42d8%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 107c91f8-7531-5871-b5d9-7f329dff42d8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:06:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576566?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '107c91f8-7531-5871-b5d9-7f329dff42d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX70LZD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576566',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 29199,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': 'Gates Group',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 SE 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576566%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [astonbarclay.gb] INFO: Saving data for 117576566: {'created_time': 1764270383.479355, 'last_price_update_time': 1764270383.479365, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576566') HTTP/1.1" 204 0
2025-11-27 19:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6295c9df-e6e7-5baa-8938-1b28314d8032 with identifier: 117514787
2025-11-27 19:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6295c9df-e6e7-5baa-8938-1b28314d8032 with identifier: 117514787
2025-11-27 19:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6295c9df-e6e7-5baa-8938-1b28314d8032 with identifier: 117514787 to the API
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276295c9df-e6e7-5baa-8938-1b28314d8032%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6295c9df-e6e7-5baa-8938-1b28314d8032: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:06:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117514787?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6295c9df-e6e7-5baa-8938-1b28314d8032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO16FCC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117514787',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 71347,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': 'Gates Group',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 TDCi 180 Titanium X 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 180 Titanium X 5dr Powershift',
 'vin': None,
 'year': 2016}
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514787%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [astonbarclay.gb] INFO: Saving data for 117514787: {'created_time': 1764270383.776059, 'last_price_update_time': 1764270383.776067, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117514787') HTTP/1.1" 204 0
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff875a153-826a-4b7e-954b-b0580899ac8e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f875a153-826a-4b7e-954b-b0580899ac8e.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9750add4-32c9-40fc-954a-ac22ed10204c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9750add4-32c9-40fc-954a-ac22ed10204c.jpg?w=600 not downloaded yet
2025-11-27 19:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452490?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e832490>
2025-11-27 19:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg?w=600 saved to cache
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117184599, 'registration': 'WD69GKL', 'account': 'AST003', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT Line 5dr', 'mileage': 82494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD69GKL/2025-11-12/image/eee80703-e24d-4fcd-b3bf-40c0147c2dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9c99e571-a41d-4bdc-8e4d-8c4dce196322_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/3008d473-3f04-4971-86ea-66c50ff400d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/ecc1b364-9626-41ab-8be6-83d1e166d5a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/03c2bc6d-fac1-4dfb-9775-59b44d79d966_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9addb163-a014-4c89-bef0-44cf8052dda8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/f3d78068-61fb-4db5-8e98-d57dfbd1ecd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e40f5d9f-e380-4320-8b18-901f9dae7ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e67dd8db-061b-4a51-af53-1938ad7737a2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'Possible wet belt problem - Coolant Issues VOSA STATES - 39K, 55K, 72K', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd18bc03-3232-469b-9171-4ab27752a720.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117184599, 'registration': 'WD69GKL', 'account': 'AST003', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT Line 5dr', 'mileage': 82494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD69GKL/2025-11-12/image/eee80703-e24d-4fcd-b3bf-40c0147c2dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9c99e571-a41d-4bdc-8e4d-8c4dce196322_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/3008d473-3f04-4971-86ea-66c50ff400d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/ecc1b364-9626-41ab-8be6-83d1e166d5a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/03c2bc6d-fac1-4dfb-9775-59b44d79d966_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9addb163-a014-4c89-bef0-44cf8052dda8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/f3d78068-61fb-4db5-8e98-d57dfbd1ecd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e40f5d9f-e380-4320-8b18-901f9dae7ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e67dd8db-061b-4a51-af53-1938ad7737a2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'Possible wet belt problem - Coolant Issues VOSA STATES - 39K, 55K, 72K', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd18bc03-3232-469b-9171-4ab27752a720.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9bb77e-2152-528d-b01d-123e231142e3 with identifier: 117184599
2025-11-27 19:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9bb77e-2152-528d-b01d-123e231142e3 with scrape type 2
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e9bb77e-2152-528d-b01d-123e231142e3 with scrape type 2
2025-11-27 19:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1e9bb77e-2152-528d-b01d-123e231142e3, identifier: 117184599
2025-11-27 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fe7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/e7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fb7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1e9bb77e-2152-528d-b01d-123e231142e3 with identifier: 117184599
2025-11-27 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1e9bb77e-2152-528d-b01d-123e231142e3 with identifier: 117184599
2025-11-27 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132760 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132760
2025-11-27 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 1e9bb77e-2152-528d-b01d-123e231142e3 spider: astonbarclay.gb
2025-11-27 19:06:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1e9bb77e-2152-528d-b01d-123e231142e3 due to rule: high_mileage_for_make.json, error: 132760 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132760
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1e9bb77e-2152-528d-b01d-123e231142e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WD69GKL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117184599',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 82494,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-31',
 'seller_name': 'TCB Group - Value',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 100 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 100 GT Line 5dr',
 'vin': None,
 'year': 2020}
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117184599%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Saving data for 117184599: {'auction_closing_time': 1764331200.0, 'created_time': 1762974281.721414, 'last_price_update_time': 1764270384.495609}
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117184599') HTTP/1.1" 204 0
2025-11-27 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0d3f5b83-857e-4921-885d-12eca9582feb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F303aff60-32c9-4c38-ada0-29a51e96ed55.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/303aff60-32c9-4c38-ada0-29a51e96ed55.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fcf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/cf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fb733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117506767, 'registration': 'GL14KNF', 'account': 'WBA003', 'make': 'MAZDA', 'model': 'CX-5 DIESEL ESTATE', 'derivative': '2.2d [175] Sport Nav 5dr AWD Auto', 'mileage': 96169, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1217, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GL14KNF/2025-11-27/image/dacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/f29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/ed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/fa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/22- 56K, 07/25- ??', 'remarks': 'VOSA STATES 53K, 64K, 76K, 88K, SPARE KEY IN OFFICE, BOOK PACK IN OFFICE (PINK TICKET 488)', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7e5b489c-fad8-4048-9e27-7000ad903fc3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117506767, 'registration': 'GL14KNF', 'account': 'WBA003', 'make': 'MAZDA', 'model': 'CX-5 DIESEL ESTATE', 'derivative': '2.2d [175] Sport Nav 5dr AWD Auto', 'mileage': 96169, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1217, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-16', 'doors': 5, 'engineSize': 2191, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GL14KNF/2025-11-27/image/dacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/f29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/ed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/fa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/22- 56K, 07/25- ??', 'remarks': 'VOSA STATES 53K, 64K, 76K, 88K, SPARE KEY IN OFFICE, BOOK PACK IN OFFICE (PINK TICKET 488)', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7e5b489c-fad8-4048-9e27-7000ad903fc3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 721eb703-2f11-5344-8465-2cc3503ffa47 with identifier: 117506767
2025-11-27 19:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 721eb703-2f11-5344-8465-2cc3503ffa47 with scrape type 1
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Fdacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/dacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117539662, 'registration': 'AO16OZD', 'account': 'WBA003', 'make': 'MAZDA', 'model': 'MX-5 CONVERTIBLE SPECIAL EDITION', 'derivative': '2.0 Sport Recaro 2dr', 'mileage': 49377, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1233, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-23', 'fuel': 'Petrol', 'motExpiry': '2026-08-04', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/AO16OZD/2025-11-26/image/db4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/be90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/d5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/e03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/ea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print PRINT @ 02/17-12k,  01/18-24k,  10/18-35k,  10/19-43k - INVOICE @ 10/22-45k', 'remarks': 'SPARE KEY - VOSA STATES 39k 44k 44k 45k 46k 46k 49k', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 161, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4515a43b-5b68-460e-b770-7305c4bbcb4a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117539662, 'registration': 'AO16OZD', 'account': 'WBA003', 'make': 'MAZDA', 'model': 'MX-5 CONVERTIBLE SPECIAL EDITION', 'derivative': '2.0 Sport Recaro 2dr', 'mileage': 49377, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1233, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-23', 'fuel': 'Petrol', 'motExpiry': '2026-08-04', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/AO16OZD/2025-11-26/image/db4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/be90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/d5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/e03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/ea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print PRINT @ 02/17-12k,  01/18-24k,  10/18-35k,  10/19-43k - INVOICE @ 10/22-45k', 'remarks': 'SPARE KEY - VOSA STATES 39k 44k 44k 45k 46k 46k 49k', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 161, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4515a43b-5b68-460e-b770-7305c4bbcb4a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf08038-1d09-5d0d-8459-1281386e27ee with identifier: 117539662
2025-11-27 19:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf08038-1d09-5d0d-8459-1281386e27ee with scrape type 1
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fdb4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/db4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117540360, 'registration': 'GY19OPU', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE 5dr Auto', 'mileage': 114606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1239, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-13', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 76K, 97K, 113K, 114K, SPARE KEY IN OFFICE **ghost alarm fitted, instructions in office**', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 71, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4d3855f-5277-4ff4-bcac-45cebba6c827.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117540360, 'registration': 'GY19OPU', 'account': 'WBA003', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '2.0 P400e HSE 5dr Auto', 'mileage': 114606, 'mileageWarranty': True, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1239, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-03-13', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 76K, 97K, 113K, 114K, SPARE KEY IN OFFICE **ghost alarm fitted, instructions in office**', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 71, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4d3855f-5277-4ff4-bcac-45cebba6c827.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 with identifier: 117540360
2025-11-27 19:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c8cd14-732d-55e9-9c1c-96083a2168e6 with scrape type 1
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117452490, 'registration': 'SB67GKV', 'account': 'FCC001', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive40e M Sport 5dr Auto', 'mileage': 113348, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB67GKV/2025-11-24/image/4aec8c6c-795e-4ffc-b3b1-c77d831caa05_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/b2566468-4162-404e-bea8-afc41d928cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/1c4bc1ca-edef-4c59-a239-bec94f7d3e3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/bbcfb972-f6b8-4a2e-8b8a-adcbba5c5f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/7d64c9d1-93df-4e6f-ba5f-62eac61ab6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/847d4496-7d2d-41fa-b6fb-d4d001284b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/44a009e8-2169-48ff-9eca-058ef8708b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/6b6ccf76-9e91-4f9a-8713-d43d8420a6e0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 03/19 22K 07/20-44K, 06/21-67K, 04/22-89K.', 'remarks': 'VOSA STATES MILES@ 111,761K, 111,769K, 111,815K, 111,827K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 78, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8496bbb-c93d-4e55-b81d-e93c6028c66c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117452490, 'registration': 'SB67GKV', 'account': 'FCC001', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive40e M Sport 5dr Auto', 'mileage': 113348, 'mileageWarranty': True, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-11-28T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB67GKV/2025-11-24/image/4aec8c6c-795e-4ffc-b3b1-c77d831caa05_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/b2566468-4162-404e-bea8-afc41d928cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/1c4bc1ca-edef-4c59-a239-bec94f7d3e3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/bbcfb972-f6b8-4a2e-8b8a-adcbba5c5f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/7d64c9d1-93df-4e6f-ba5f-62eac61ab6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/847d4496-7d2d-41fa-b6fb-d4d001284b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/44a009e8-2169-48ff-9eca-058ef8708b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/6b6ccf76-9e91-4f9a-8713-d43d8420a6e0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 03/19 22K 07/20-44K, 06/21-67K, 04/22-89K.', 'remarks': 'VOSA STATES MILES@ 111,761K, 111,769K, 111,815K, 111,827K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 78, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8496bbb-c93d-4e55-b81d-e93c6028c66c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-11-27 19:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e65083d-5e5f-588d-ae0f-977434105342 with scrape type 2
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e65083d-5e5f-588d-ae0f-977434105342 with scrape type 2
2025-11-27 19:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5e65083d-5e5f-588d-ae0f-977434105342, identifier: 117452490
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F85806a3d-8524-4474-bb7e-055a80a1c54c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/85806a3d-8524-4474-bb7e-055a80a1c54c.jpg?w=600 not downloaded yet
2025-11-27 19:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-11-27 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-11-27 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182415 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182415
2025-11-27 19:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5e65083d-5e5f-588d-ae0f-977434105342 spider: astonbarclay.gb
2025-11-27 19:06:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5e65083d-5e5f-588d-ae0f-977434105342 due to rule: high_mileage_for_country.json, error: 182415 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182415
{'auction_title': '',
 'c_o_2_emission_value': 78,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '5e65083d-5e5f-588d-ae0f-977434105342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SB67GKV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452490',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X5 ESTATE',
 'odometer': 113348,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-09',
 'seller_name': 'Local Dealer Group',
 'title': 'BMW X5 ESTATE xDrive40e M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive40e M Sport 5dr Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [astonbarclay.gb] INFO: Saving data for 117452490: {'auction_closing_time': 1764331200.0, 'created_time': 1764010992.773169, 'last_price_update_time': 1764270385.000094}
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452490') HTTP/1.1" 204 0
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb85b90>
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg?w=600 not downloaded yet
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fd3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/d3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Ffedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Ff29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/f29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fbe90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/be90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9750add4-32c9-40fc-954a-ac22ed10204c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f875a153-826a-4b7e-954b-b0580899ac8e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a0109d46-5560-407b-893a-35e8589b8ce4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2ac23139-b44f-4e48-809b-8bfe483ed654.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2ac23139-b44f-4e48-809b-8bfe483ed654.jpg?w=600 not downloaded yet
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbd310>
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fc28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe5fc10>
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg?w=600 saved to cache
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea39bd0>
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0d3f5b83-857e-4921-885d-12eca9582feb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0d3f5b83-857e-4921-885d-12eca9582feb.jpg?w=600 saved to cache
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec2ef90>
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg?w=600 saved to cache
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbc890>
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg?w=600 saved to cache
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F24754160-8246-4b74-8090-fa38ebe16722.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/24754160-8246-4b74-8090-fa38ebe16722.jpg?w=600 not downloaded yet
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Fed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/ed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117351302?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg?w=600 not downloaded yet
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecadfd0>
2025-11-27 19:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg?w=600 saved to cache
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc5910>
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe34f10>
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e918510>
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fc7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/dacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/db4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/e7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fd5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/d5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252Fb1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdf7250>
2025-11-27 19:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9750add4-32c9-40fc-954a-ac22ed10204c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9750add4-32c9-40fc-954a-ac22ed10204c.jpg?w=600 saved to cache
2025-11-27 19:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb06990>
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdf4890>
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_11.jpg HTTP/1.1" 201 0
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg?w=600 saved to cache
2025-11-27 19:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d2d3710>
2025-11-27 19:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff875a153-826a-4b7e-954b-b0580899ac8e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f875a153-826a-4b7e-954b-b0580899ac8e.jpg?w=600 saved to cache
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c353490>
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa0109d46-5560-407b-893a-35e8589b8ce4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a0109d46-5560-407b-893a-35e8589b8ce4.jpg?w=600 saved to cache
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb06990>
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg?w=600 saved to cache
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116707815, 'registration': 'KY67GUW', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 SE 5dr Auto', 'mileage': 59886, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-12', 'fuel': 'Diesel', 'motExpiry': '2026-08-23', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/KY67GUW/2025-10-31/image/e807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/dd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/d6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 5/21-29K, 9/22-34K, 8/23-42K, 8/24-50K, 8/25-58K', 'remarks': 'VOSA STATES 34K, 42K, 50K, 58K SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f20bae1-8640-499b-903d-de725bbfe8c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116707815, 'registration': 'KY67GUW', 'account': 'MAN027', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 TD6 SE 5dr Auto', 'mileage': 59886, 'mileageWarranty': False, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-12', 'fuel': 'Diesel', 'motExpiry': '2026-08-23', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/KY67GUW/2025-10-31/image/e807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/dd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/d6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 5/21-29K, 9/22-34K, 8/23-42K, 8/24-50K, 8/25-58K', 'remarks': 'VOSA STATES 34K, 42K, 50K, 58K SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 189, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f20bae1-8640-499b-903d-de725bbfe8c4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c84126ae-c804-5252-b667-bc1a2d56568b with identifier: 116707815
2025-11-27 19:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c84126ae-c804-5252-b667-bc1a2d56568b with scrape type 1
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252Fe807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/e807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117518338, 'registration': 'PF16EJG', 'account': 'STA058', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE Black 5dr Auto', 'mileage': 97244, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2806, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/PF16EJG/2025-11-27/image/596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/f9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/baf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e43b6f8d-5130-4b55-888e-ba8a1e32f9cb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117518338, 'registration': 'PF16EJG', 'account': 'STA058', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE Black 5dr Auto', 'mileage': 97244, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2806, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/PF16EJG/2025-11-27/image/596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/f9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/baf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg?w=600', 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e43b6f8d-5130-4b55-888e-ba8a1e32f9cb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6a859b0-f331-5b6b-816a-b37318992970 with identifier: 117518338
2025-11-27 19:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a859b0-f331-5b6b-816a-b37318992970 with scrape type 1
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/cf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/be90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/303aff60-32c9-4c38-ada0-29a51e96ed55.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/85806a3d-8524-4474-bb7e-055a80a1c54c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue)
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117351302, 'registration': 'MA21VYW', 'account': 'MER178', 'make': 'AUDI', 'model': 'A1 SPORTBACK', 'derivative': '30 TFSI 110 S Line 5dr', 'mileage': 43302, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2813, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MA21VYW/2025-11-19/image/582fe596-b94b-417d-8bfd-52845e56ccc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/e2f94f81-526d-4720-bb62-0eb6ea261025_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/81dd1ffd-68f2-4702-95e3-88b7aa69f6bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/05eb6062-13fc-4608-afb8-14c2c4a1a533_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/e7002d46-3f35-460f-9803-1827f67d7faa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/06335980-b460-4d1b-84af-7e729a77139f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/0097b6a3-fa79-4440-b0b1-12b7cc744426_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/5b4b5190-718b-4895-9866-a28f73d3a8ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/fa787a56-7145-44ad-8675-cb1c70998dff_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 - 35K', 'remarks': 'VOSA STATES, 33K, 43K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf71a591-bc0a-4b81-b9aa-79faedf21bd3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117351302, 'registration': 'MA21VYW', 'account': 'MER178', 'make': 'AUDI', 'model': 'A1 SPORTBACK', 'derivative': '30 TFSI 110 S Line 5dr', 'mileage': 43302, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2813, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MA21VYW/2025-11-19/image/582fe596-b94b-417d-8bfd-52845e56ccc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/e2f94f81-526d-4720-bb62-0eb6ea261025_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/81dd1ffd-68f2-4702-95e3-88b7aa69f6bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/05eb6062-13fc-4608-afb8-14c2c4a1a533_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/e7002d46-3f35-460f-9803-1827f67d7faa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/06335980-b460-4d1b-84af-7e729a77139f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/0097b6a3-fa79-4440-b0b1-12b7cc744426_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/5b4b5190-718b-4895-9866-a28f73d3a8ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA21VYW/2025-11-19/image/fa787a56-7145-44ad-8675-cb1c70998dff_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/25 - 35K', 'remarks': 'VOSA STATES, 33K, 43K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bf71a591-bc0a-4b81-b9aa-79faedf21bd3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0b692e-29ae-5972-bba6-96f5c99f4fa6 with identifier: 117351302
2025-11-27 19:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0b692e-29ae-5972-bba6-96f5c99f4fa6 with scrape type 2
2025-11-27 19:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b0b692e-29ae-5972-bba6-96f5c99f4fa6 with scrape type 2
2025-11-27 19:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5b0b692e-29ae-5972-bba6-96f5c99f4fa6, identifier: 117351302
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb58f90>
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fb7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9084d0>
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_12.jpg HTTP/1.1" 201 0
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg?w=600 saved to cache
2025-11-27 19:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5b0b692e-29ae-5972-bba6-96f5c99f4fa6 with identifier: 117351302
2025-11-27 19:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5b0b692e-29ae-5972-bba6-96f5c99f4fa6 with identifier: 117351302
2025-11-27 19:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5b0b692e-29ae-5972-bba6-96f5c99f4fa6 with identifier: 117351302 to the API
2025-11-27 19:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117351302?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5b0b692e-29ae-5972-bba6-96f5c99f4fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MA21VYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117351302',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A1 SPORTBACK',
 'odometer': 43302,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Hedin Automotive',
 'title': 'AUDI A1 SPORTBACK 30 TFSI 110 S Line 5dr',
 'transmission': 'manual',
 'trim': '30 TFSI 110 S Line 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117351302%27 HTTP/1.1" 200 None
2025-11-27 19:06:31 [astonbarclay.gb] INFO: Saving data for 117351302: {'auction_closing_time': 1764583200.0, 'created_time': 1763751800.793052, 'last_price_update_time': 1764270391.551387}
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117351302') HTTP/1.1" 204 0
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc5250>
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Fdacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/dacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98f650>
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98cc10>
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fdb4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/db4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc4850>
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fe7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/e7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/ed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/f29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fe03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/e03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/24754160-8246-4b74-8090-fa38ebe16722.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/d3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2ac23139-b44f-4e48-809b-8bfe483ed654.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue)
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe412d0>
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_10.jpg HTTP/1.1" 201 0
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg?w=600 saved to cache
2025-11-27 19:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e954ad0>
2025-11-27 19:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg?w=600 saved to cache
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea47b50>
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Fb733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e955950>
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fcf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/cf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd11d90>
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fbe90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/be90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d1b3510>
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e993750>
2025-11-27 19:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg?w=600 saved to cache
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc7210>
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_13.jpg HTTP/1.1" 201 0
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F303aff60-32c9-4c38-ada0-29a51e96ed55.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/303aff60-32c9-4c38-ada0-29a51e96ed55.jpg?w=600 saved to cache
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9933d0>
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F85806a3d-8524-4474-bb7e-055a80a1c54c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/85806a3d-8524-4474-bb7e-055a80a1c54c.jpg?w=600 saved to cache
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117525337?view=catalogue)
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/ea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Ff9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/f9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/d5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/e807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb99810>
2025-11-27 19:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea48410>
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdeabd0>
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252Ffedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Ffa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/fa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Fbaf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/baf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea473d0>
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec47250>
2025-11-27 19:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Fed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/ed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe40b50>
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Ff29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/f29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e82e2d0>
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_15.jpg HTTP/1.1" 201 0
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F24754160-8246-4b74-8090-fa38ebe16722.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/24754160-8246-4b74-8090-fa38ebe16722.jpg?w=600 saved to cache
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe40e10>
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9ea150>
2025-11-27 19:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fd3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/d3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c6ebed0>
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2ac23139-b44f-4e48-809b-8bfe483ed654.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2ac23139-b44f-4e48-809b-8bfe483ed654.jpg?w=600 saved to cache
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117542051?view=catalogue)
2025-11-27 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252Fdd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/dd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eca34d0>
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg?w=600 saved to cache
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a17989f4-9329-5f2d-ba8c-eac9bf646124
2025-11-27 19:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a17989f4-9329-5f2d-ba8c-eac9bf646124, skipping ID generation
2025-11-27 19:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a17989f4-9329-5f2d-ba8c-eac9bf646124 with scrape type 1
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a17989f4-9329-5f2d-ba8c-eac9bf646124 from tracking dictionaries
2025-11-27 19:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a17989f4-9329-5f2d-ba8c-eac9bf646124 sending to next pipeline
2025-11-27 19:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a17989f4-9329-5f2d-ba8c-eac9bf646124, identifier: 117525337
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d1c9850>
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fd5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/d5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fda4e50>
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e95b2d0>
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252Fb1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c71b290>
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252Fe807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/e807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d489890>
2025-11-27 19:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a17989f4-9329-5f2d-ba8c-eac9bf646124 with identifier: 117525337
2025-11-27 19:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a17989f4-9329-5f2d-ba8c-eac9bf646124 with identifier: 117525337
2025-11-27 19:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a17989f4-9329-5f2d-ba8c-eac9bf646124 with identifier: 117525337 to the API
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/b484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'a17989f4-9329-5f2d-ba8c-eac9bf646124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WO21ZXD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117525337',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'YARIS HATCHBACK',
 'odometer': 27944,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77170,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/9e93f82c-da4b-4b86-b155-28032bf4dd78.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74065,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/f875a153-826a-4b7e-954b-b0580899ac8e.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59311,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/9750add4-32c9-40fc-954a-ac22ed10204c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64720,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/70a10df0-ab26-45bf-93d9-354d20c74ff2.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76319,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/85806a3d-8524-4474-bb7e-055a80a1c54c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69400,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/2ac23139-b44f-4e48-809b-8bfe483ed654.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a17989f4-9329-5f2d-ba8c-eac9bf646124/a17989f4-9329-5f2d-ba8c-eac9bf646124_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69503,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/b484165c-4cc1-4647-9a3e-a68d0b6fcf0b.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': 'Hedin Automotive',
 'title': 'TOYOTA YARIS HATCHBACK 1.5 Hybrid Icon 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid Icon 5dr CVT',
 'vin': None,
 'year': 2021}
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117525337%27 HTTP/1.1" 200 None
2025-11-27 19:06:40 [astonbarclay.gb] INFO: Saving data for 117525337: {'created_time': 1764270400.475929, 'last_price_update_time': 1764270400.475937, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117525337') HTTP/1.1" 204 0
2025-11-27 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252Fd6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/d6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea52810>
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84ca10>
2025-11-27 19:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec29050>
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/e03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/f9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea84a90>
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fffd310>
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e98cf10>
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdf64d0>
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FFP68XSJ%252F2025-11-27%252Fimage%252F2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30f360f0-a557-5a39-ad4b-7c9f2412e678
2025-11-27 19:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30f360f0-a557-5a39-ad4b-7c9f2412e678, skipping ID generation
2025-11-27 19:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f360f0-a557-5a39-ad4b-7c9f2412e678 with scrape type 1
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30f360f0-a557-5a39-ad4b-7c9f2412e678 from tracking dictionaries
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30f360f0-a557-5a39-ad4b-7c9f2412e678 sending to next pipeline
2025-11-27 19:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 30f360f0-a557-5a39-ad4b-7c9f2412e678, identifier: 117542051
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec29d10>
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee2510>
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_14.jpg HTTP/1.1" 201 0
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg?w=600 saved to cache
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Fc36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051
2025-11-27 19:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051
2025-11-27 19:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 30f360f0-a557-5a39-ad4b-7c9f2412e678 with identifier: 117542051 to the API
2025-11-27 19:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '30f360f0-a557-5a39-ad4b-7c9f2412e678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FP68XSJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117542051',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'UP HATCHBACK SPECIAL EDS',
 'odometer': 19328,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41788,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/6fbad83d-ae00-405b-8234-4b9eafdecf1f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37381,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c28f3851-7798-4b9c-a3a2-2899adef5030_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36273,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/c7fae7a8-6405-437f-9389-806c03b9a3b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35758,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/9d546b4f-2bfd-4176-a4a0-d0f5c2be977e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57009,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b7142c77-6913-4e6e-9fc0-ea25554b24e0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51437,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/b733d1ed-507c-4234-8bb8-6d5c28d4a530_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61124,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/fedd1c50-cdc7-42f5-b4a2-21014cd637b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48838,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/06f0bd4f-78f7-4124-89fd-e6cbcf2b0c59_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f360f0-a557-5a39-ad4b-7c9f2412e678/30f360f0-a557-5a39-ad4b-7c9f2412e678_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51303,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/FP68XSJ/2025-11-27/image/2a3ecc2e-37b0-41b0-9b0c-ffe5dddfd003_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-11',
 'seller_name': 'UKCGR - Premium',
 'title': 'VOLKSWAGEN UP HATCHBACK SPECIAL EDS 1.0 Up Beats 5dr',
 'transmission': 'manual',
 'trim': '1.0 Up Beats 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542051%27 HTTP/1.1" 200 None
2025-11-27 19:06:43 [astonbarclay.gb] INFO: Saving data for 117542051: {'created_time': 1764270403.155883, 'last_price_update_time': 1764270403.155892, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117542051') HTTP/1.1" 204 0
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd91c90>
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg?w=600 saved to cache
2025-11-27 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/baf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9eb26550>
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd91410>
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb49e90>
2025-11-27 19:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252F824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/ea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/fa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Fc65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea9ba90>
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fe03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/e03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecbc490>
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c749290>
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea9b2d0>
2025-11-27 19:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Ff9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/f9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9f5790>
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d8bab155-1a13-436f-b78a-0ecb27a7615f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117331028?view=catalogue)
2025-11-27 19:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/dd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec12910>
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c71a090>
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fdcae50>
2025-11-27 19:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Fbaf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/baf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/b8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/c9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117541958?view=catalogue)
2025-11-27 19:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fea5010>
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252Fea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/ea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb4a210>
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d386d90>
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea85290>
2025-11-27 19:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252Ffa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/fa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e939910>
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/d6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117540360?view=catalogue)
2025-11-27 19:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AO16OZD/2025-11-26/image/4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117539662?view=catalogue)
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fefe1d0>
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd8bab155-1a13-436f-b78a-0ecb27a7615f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d8bab155-1a13-436f-b78a-0ecb27a7615f.jpg?w=600 saved to cache
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b15a9f4-4b46-57c0-a055-8d89496d1557
2025-11-27 19:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b15a9f4-4b46-57c0-a055-8d89496d1557, skipping ID generation
2025-11-27 19:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b15a9f4-4b46-57c0-a055-8d89496d1557 with scrape type 1
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8b15a9f4-4b46-57c0-a055-8d89496d1557 from tracking dictionaries
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b15a9f4-4b46-57c0-a055-8d89496d1557 sending to next pipeline
2025-11-27 19:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8b15a9f4-4b46-57c0-a055-8d89496d1557, identifier: 117331028
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e93a090>
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252Fdd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/dd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb98bd0>
2025-11-27 19:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8b15a9f4-4b46-57c0-a055-8d89496d1557 with identifier: 117331028
2025-11-27 19:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8b15a9f4-4b46-57c0-a055-8d89496d1557 with identifier: 117331028
2025-11-27 19:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8b15a9f4-4b46-57c0-a055-8d89496d1557 with identifier: 117331028 to the API
2025-11-27 19:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/d8bab155-1a13-436f-b78a-0ecb27a7615f.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8b15a9f4-4b46-57c0-a055-8d89496d1557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WN18BWW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117331028',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL SALOON',
 'odometer': 89808,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70514,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/a0109d46-5560-407b-893a-35e8589b8ce4.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67999,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/4fde5ff4-aecb-4214-a52b-349d1f20957e.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69734,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/5d5a07e8-9824-4949-bbf4-d45cc4006041.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85240,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/0d3f5b83-857e-4921-885d-12eca9582feb.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89416,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/97c50e51-5bb6-474d-8b63-c5609372c3bd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78549,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/b5e2fd8b-7db9-4b6e-9ecf-181d07d431fd.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85631,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/1682c8bc-3eb2-4198-91ba-c37d8b0ff1c8.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44028,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/4064c86f-67bb-45f9-9a99-446d9c56ef15.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57756,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/d8bab155-1a13-436f-b78a-0ecb27a7615f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59071,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/847a562f-daf0-44cf-8ef5-a02c3361e80f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53761,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/12c42d89-10e8-493d-b4f7-ce5c55129b8a.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71955,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/649b9d28-6eec-4aab-b0eb-903ae9feaca9.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73327,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/74dfbd81-f20b-4508-8a3a-3c48e133782a.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74068,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/303aff60-32c9-4c38-ada0-29a51e96ed55.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73687,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/5641a7f7-3e2d-4f67-9746-4edadabcdbf9.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b15a9f4-4b46-57c0-a055-8d89496d1557/8b15a9f4-4b46-57c0-a055-8d89496d1557_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46986,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/24754160-8246-4b74-8090-fa38ebe16722.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ C CLASS DIESEL SALOON C220d AMG Line 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C220d AMG Line 4dr 9G-Tronic',
 'vin': None,
 'year': 2018}
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331028%27 HTTP/1.1" 200 None
2025-11-27 19:06:49 [astonbarclay.gb] INFO: Saving data for 117331028: {'created_time': 1764270409.447558, 'last_price_update_time': 1764270409.447569, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117331028') HTTP/1.1" 204 0
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c34a150>
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/dcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/e79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117506767?view=catalogue)
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea474d0>
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_11.jpg HTTP/1.1" 201 0
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Fb8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/b8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe40410>
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKJ21NXT%252F2025-11-27%252Fimage%252Fc9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/c9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53def01d-cb77-57c1-93f7-66212e7eedff
2025-11-27 19:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53def01d-cb77-57c1-93f7-66212e7eedff, skipping ID generation
2025-11-27 19:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53def01d-cb77-57c1-93f7-66212e7eedff with scrape type 1
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 53def01d-cb77-57c1-93f7-66212e7eedff from tracking dictionaries
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53def01d-cb77-57c1-93f7-66212e7eedff sending to next pipeline
2025-11-27 19:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 53def01d-cb77-57c1-93f7-66212e7eedff, identifier: 117541958
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9e9590>
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd44290>
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 53def01d-cb77-57c1-93f7-66212e7eedff with identifier: 117541958
2025-11-27 19:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 53def01d-cb77-57c1-93f7-66212e7eedff with identifier: 117541958
2025-11-27 19:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 53def01d-cb77-57c1-93f7-66212e7eedff with identifier: 117541958 to the API
2025-11-27 19:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/c9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '53def01d-cb77-57c1-93f7-66212e7eedff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KJ21NXT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117541958',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SUZUKI',
 'model': 'SWIFT HATCHBACK',
 'odometer': 22880,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/c9bcf126-823f-4da5-9080-82533a1b6961_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35446,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/824806ce-7331-4f78-a874-ced9438c734e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33022,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/9094f8b4-a715-43c3-8cdc-c55f3acde312_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31716,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/6632f230-6453-457f-8c8c-e2ba59c03880_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65633,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/e7dbe6f2-e222-4bbc-a3cc-7a209176f0aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40413,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/cf430dee-1491-4cb1-a4ee-e2e3172cc945_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55333,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/d3ec7ca1-3550-46db-844d-495eb96f2f1b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58380,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/554a44e9-db4f-430a-ad5d-9993c1d23521_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42062,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/83d30372-acf9-4f2a-b486-31f34896770f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53def01d-cb77-57c1-93f7-66212e7eedff/53def01d-cb77-57c1-93f7-66212e7eedff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51278,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KJ21NXT/2025-11-27/image/5e01dea3-9804-4d1c-ba6a-066d433f075b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': 'UKCGR - Premium',
 'title': 'SUZUKI SWIFT HATCHBACK 1.2 Dualjet 83 12V Hybrid SZ5 5dr',
 'transmission': 'manual',
 'trim': '1.2 Dualjet 83 12V Hybrid SZ5 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541958%27 HTTP/1.1" 200 None
2025-11-27 19:06:51 [astonbarclay.gb] INFO: Saving data for 117541958: {'created_time': 1764270411.191314, 'last_price_update_time': 1764270411.191327, 'auction_closing_time': 1764756000.0}
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117541958') HTTP/1.1" 204 0
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0e110>
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252Fd6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/d6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec94210>
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGY19OPU%252F2025-11-27%252Fimage%252F3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f6c8cd14-732d-55e9-9c1c-96083a2168e6
2025-11-27 19:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6c8cd14-732d-55e9-9c1c-96083a2168e6, skipping ID generation
2025-11-27 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c8cd14-732d-55e9-9c1c-96083a2168e6 with scrape type 1
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f6c8cd14-732d-55e9-9c1c-96083a2168e6 from tracking dictionaries
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6c8cd14-732d-55e9-9c1c-96083a2168e6 sending to next pipeline
2025-11-27 19:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f6c8cd14-732d-55e9-9c1c-96083a2168e6, identifier: 117540360
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb9d010>
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAO16OZD%252F2025-11-26%252Fimage%252F4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AO16OZD/2025-11-26/image/4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bf08038-1d09-5d0d-8459-1281386e27ee
2025-11-27 19:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bf08038-1d09-5d0d-8459-1281386e27ee, skipping ID generation
2025-11-27 19:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf08038-1d09-5d0d-8459-1281386e27ee with scrape type 1
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6bf08038-1d09-5d0d-8459-1281386e27ee from tracking dictionaries
2025-11-27 19:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bf08038-1d09-5d0d-8459-1281386e27ee sending to next pipeline
2025-11-27 19:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6bf08038-1d09-5d0d-8459-1281386e27ee, identifier: 117539662
2025-11-27 19:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 with identifier: 117540360
2025-11-27 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 with identifier: 117540360
2025-11-27 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184440 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184440
2025-11-27 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f6c8cd14-732d-55e9-9c1c-96083a2168e6 spider: astonbarclay.gb
2025-11-27 19:06:52 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f6c8cd14-732d-55e9-9c1c-96083a2168e6 due to rule: high_mileage_for_country.json, error: 184440 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184440
{'auction_title': '',
 'c_o_2_emission_value': 71,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'f6c8cd14-732d-55e9-9c1c-96083a2168e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY19OPU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117540360',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT ESTATE',
 'odometer': 114606,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34236,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/809672b8-93a3-4d52-9df5-1cd8cccee306_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35915,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/6288ffd8-16a6-481c-800d-9e6f4baba66b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36810,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/0bcf6000-a400-44d6-8dcb-e799404c2ca3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33836,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/b1e4adb8-7a64-499e-98fd-5a85a546992a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44979,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/73f0ef04-2721-41d3-8fb6-9e2f3fc0c962_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56120,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/15783f06-e821-430f-94cd-bdb04b21e609_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45106,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3a508488-bacb-46fd-b890-3ae23e01e40c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46007,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/4b59e7be-a3b7-4d63-9447-ba1137d5d103_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38598,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/883e2812-f1a6-495e-ba48-af12406fbb45_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c8cd14-732d-55e9-9c1c-96083a2168e6/f6c8cd14-732d-55e9-9c1c-96083a2168e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54270,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GY19OPU/2025-11-27/image/3c6b7816-1686-43d2-b996-3af60ede79e3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-13',
 'seller_name': 'UKCGR - Select',
 'title': 'LAND ROVER RANGE ROVER SPORT ESTATE 2.0 P400e HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 P400e HSE 5dr Auto',
 'vin': None,
 'year': 2019}
2025-11-27 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540360%27 HTTP/1.1" 200 None
2025-11-27 19:06:52 [astonbarclay.gb] INFO: Saving data for 117540360: {'created_time': 1764270412.256573, 'last_price_update_time': 1764270412.256582, 'auction_closing_time': 1764610200.0}
2025-11-27 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117540360') HTTP/1.1" 204 0
2025-11-27 19:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6bf08038-1d09-5d0d-8459-1281386e27ee with identifier: 117539662
2025-11-27 19:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6bf08038-1d09-5d0d-8459-1281386e27ee with identifier: 117539662
2025-11-27 19:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6bf08038-1d09-5d0d-8459-1281386e27ee with identifier: 117539662 to the API
2025-11-27 19:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AO16OZD/2025-11-26/image/4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '6bf08038-1d09-5d0d-8459-1281386e27ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO16OZD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117539662',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MAZDA',
 'model': 'MX-5 CONVERTIBLE SPECIAL EDITION',
 'odometer': 49377,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33887,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/db4d4fa6-5d93-4d50-892d-f1d23a91bb44_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33300,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/be90f564-c9b9-4ab4-9bcc-50326502b120_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34224,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/96a823f0-d5b7-43fb-92ba-e17ed162d29d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34110,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/d5881906-3ea2-4420-93e1-cb5f91b1f4ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47647,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/24390208-f658-41d0-8204-84e5e418e0a8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46660,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/e03e25a7-626f-4b21-87bd-c00b3ea8f38e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56191,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/ea6cc0b4-f199-469b-9bfc-76eb95b14068_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58256,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/1d00527e-a8ef-4392-b40a-1c417cfed01d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf08038-1d09-5d0d-8459-1281386e27ee/6bf08038-1d09-5d0d-8459-1281386e27ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65176,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AO16OZD/2025-11-26/image/4683a5e5-f782-42b6-965c-3e8defac9c4e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-23',
 'seller_name': 'UKCGR - Select',
 'title': 'MAZDA MX-5 CONVERTIBLE SPECIAL EDITION 2.0 Sport Recaro 2dr',
 'transmission': 'manual',
 'trim': '2.0 Sport Recaro 2dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539662%27 HTTP/1.1" 200 None
2025-11-27 19:06:53 [astonbarclay.gb] INFO: Saving data for 117539662: {'created_time': 1764270413.564798, 'last_price_update_time': 1764270413.564807, 'auction_closing_time': 1764610200.0}
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117539662') HTTP/1.1" 204 0
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9ea58990>
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Fc36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PF16EJG/2025-11-27/image/8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117518338?view=catalogue)
2025-11-27 19:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/de211143-d947-4b00-822e-37f05bb444f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9904d0>
2025-11-27 19:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_10.jpg HTTP/1.1" 201 0
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Fdcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/dcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c7486d0>
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Fe79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/e79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eae8f50>
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fea8390>
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGL14KNF%252F2025-11-27%252Fimage%252F5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 721eb703-2f11-5344-8465-2cc3503ffa47
2025-11-27 19:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 721eb703-2f11-5344-8465-2cc3503ffa47, skipping ID generation
2025-11-27 19:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 721eb703-2f11-5344-8465-2cc3503ffa47 with scrape type 1
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 721eb703-2f11-5344-8465-2cc3503ffa47 from tracking dictionaries
2025-11-27 19:06:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 721eb703-2f11-5344-8465-2cc3503ffa47 sending to next pipeline
2025-11-27 19:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 721eb703-2f11-5344-8465-2cc3503ffa47, identifier: 117506767
2025-11-27 19:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/23acd02e-db28-490c-b235-acb23df75767_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KY67GUW/2025-10-31/image/7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116707815?view=catalogue)
2025-11-27 19:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 721eb703-2f11-5344-8465-2cc3503ffa47 with identifier: 117506767
2025-11-27 19:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 721eb703-2f11-5344-8465-2cc3503ffa47 with identifier: 117506767
2025-11-27 19:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154768 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154768
2025-11-27 19:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 721eb703-2f11-5344-8465-2cc3503ffa47 spider: astonbarclay.gb
2025-11-27 19:06:55 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 721eb703-2f11-5344-8465-2cc3503ffa47 due to rule: high_mileage_for_country.json, error: 154768 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154768
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '721eb703-2f11-5344-8465-2cc3503ffa47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GL14KNF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117506767',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MAZDA',
 'model': 'CX-5 DIESEL ESTATE',
 'odometer': 96169,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35890,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/dacd0537-bc96-4361-acd2-45cd22be4764_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34300,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/f29becfc-aaf0-4bbd-a3a3-dadfa88716b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36051,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/ed85fc16-49c9-4679-9eed-02ca47e69ac6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32521,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/77efa930-db14-4ed0-99c5-2530b11b4ec7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48476,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5ce9d796-a8f8-4bd6-a87b-27f28dbd1991_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24854,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/7c5e82f8-5a5c-463c-a8e2-c90a33d5ab80_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53178,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/11d3aecf-9cbe-48bc-846f-23f3fd3cd9ba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51491,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/fa6303aa-b80f-437b-9b19-dc76c05b3d15_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40542,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/3713364f-cf90-4997-a5fd-c66865b6dac0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721eb703-2f11-5344-8465-2cc3503ffa47/721eb703-2f11-5344-8465-2cc3503ffa47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49939,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GL14KNF/2025-11-27/image/5b8b3480-8cc5-4e82-9056-b05bbe5d3587_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': 'UKCGR - Select',
 'title': 'MAZDA CX-5 DIESEL ESTATE 2.2d [175] Sport Nav 5dr AWD Auto',
 'transmission': 'automatic',
 'trim': '2.2d [175] Sport Nav 5dr AWD Auto',
 'vin': None,
 'year': 2018}
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506767%27 HTTP/1.1" 200 None
2025-11-27 19:06:55 [astonbarclay.gb] INFO: Saving data for 117506767: {'created_time': 1764270415.324379, 'last_price_update_time': 1764270415.324389, 'auction_closing_time': 1764610200.0}
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117506767') HTTP/1.1" 204 0
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d05b290>
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg?w=600 saved to cache
2025-11-27 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd56a50>
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe985d0>
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe29b10>
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252Fc65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb2e10>
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/d126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb0750>
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPF16EJG%252F2025-11-27%252Fimage%252F8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PF16EJG/2025-11-27/image/8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6a859b0-f331-5b6b-816a-b37318992970
2025-11-27 19:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6a859b0-f331-5b6b-816a-b37318992970, skipping ID generation
2025-11-27 19:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a859b0-f331-5b6b-816a-b37318992970 with scrape type 1
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c6a859b0-f331-5b6b-816a-b37318992970 from tracking dictionaries
2025-11-27 19:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6a859b0-f331-5b6b-816a-b37318992970 sending to next pipeline
2025-11-27 19:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c6a859b0-f331-5b6b-816a-b37318992970, identifier: 117518338
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c37c110>
2025-11-27 19:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feb0890>
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e93b810>
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fde211143-d947-4b00-822e-37f05bb444f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/de211143-d947-4b00-822e-37f05bb444f7_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c6a859b0-f331-5b6b-816a-b37318992970 with identifier: 117518338
2025-11-27 19:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c6a859b0-f331-5b6b-816a-b37318992970 with identifier: 117518338
2025-11-27 19:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156498 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156498
2025-11-27 19:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c6a859b0-f331-5b6b-816a-b37318992970 spider: astonbarclay.gb
2025-11-27 19:06:57 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c6a859b0-f331-5b6b-816a-b37318992970 due to rule: high_mileage_for_country.json, error: 156498 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156498
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c6a859b0-f331-5b6b-816a-b37318992970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PF16EJG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117518338',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 97244,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37433,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/596879c9-70ca-42af-ba97-3bc8523f9a46_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41422,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/2debf619-0e56-44c7-b57e-bbac9b4b5c69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41179,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4aa69492-a928-4ff3-8bfb-17847d7bc5af_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40249,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/f9991e24-b9e9-4a95-891b-4acfe6d32638_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42777,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/baf70f42-d56f-4076-af38-1162aa4e56da_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46955,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/239a4c84-2706-4f72-bc17-cfe3e2b12f90_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47121,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/4370a786-ae08-413f-9f74-ac26d5fa0f11_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53225,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c36d4cb1-44f1-4d12-be6a-a625348d6373_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45799,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/c65e4c3d-c415-4bfe-8150-d77a0f079e82_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6a859b0-f331-5b6b-816a-b37318992970/c6a859b0-f331-5b6b-816a-b37318992970_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52412,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PF16EJG/2025-11-27/image/8d6e4c57-cd32-4d0d-9914-0fc153027195_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-25',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 HSE Black 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE Black 5dr Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117518338%27 HTTP/1.1" 200 None
2025-11-27 19:06:57 [astonbarclay.gb] INFO: Saving data for 117518338: {'created_time': 1764270417.842383, 'last_price_update_time': 1764270417.842393, 'auction_closing_time': 1764583200.0}
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117518338') HTTP/1.1" 204 0
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e809750>
2025-11-27 19:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F23acd02e-db28-490c-b235-acb23df75767_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/23acd02e-db28-490c-b235-acb23df75767_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d4a3e50>
2025-11-27 19:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKY67GUW%252F2025-10-31%252Fimage%252F7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KY67GUW/2025-10-31/image/7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg?w=600 saved to cache
2025-11-27 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c84126ae-c804-5252-b667-bc1a2d56568b
2025-11-27 19:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c84126ae-c804-5252-b667-bc1a2d56568b, skipping ID generation
2025-11-27 19:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c84126ae-c804-5252-b667-bc1a2d56568b with scrape type 1
2025-11-27 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c84126ae-c804-5252-b667-bc1a2d56568b from tracking dictionaries
2025-11-27 19:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c84126ae-c804-5252-b667-bc1a2d56568b sending to next pipeline
2025-11-27 19:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c84126ae-c804-5252-b667-bc1a2d56568b, identifier: 116707815
2025-11-27 19:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9129a528-6888-4849-9486-8328c2caf3e7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c84126ae-c804-5252-b667-bc1a2d56568b with identifier: 116707815
2025-11-27 19:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c84126ae-c804-5252-b667-bc1a2d56568b with identifier: 116707815
2025-11-27 19:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c84126ae-c804-5252-b667-bc1a2d56568b with identifier: 116707815 to the API
2025-11-27 19:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KY67GUW/2025-10-31/image/7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c84126ae-c804-5252-b667-bc1a2d56568b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KY67GUW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116707815',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY DIESEL SW',
 'odometer': 59886,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40711,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/e807d2a7-85a5-4222-a966-8e9a9d05fc83_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41328,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/23cbdb06-65df-4d53-bec9-5cdf67d8aa9c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38680,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/283fdea1-ff59-4eb7-a1d0-4b2ad3af7957_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40700,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/0e0faa50-911f-4105-a5fc-2f14c1ed2fd1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42334,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/40ceb4aa-05b5-4766-be8e-8e6f5a1b686a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39556,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/dd35e57c-4fc7-4cbe-b594-80e0bb2bd61e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62747,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/d6bd1afd-7c4b-4146-858d-70cb5f822c6b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53693,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/1d597e8e-ef0f-4283-9a79-294d2300c1eb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48197,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/57fc3ace-17b3-452c-a1a2-e4cbc4ae0eb9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c84126ae-c804-5252-b667-bc1a2d56568b/c84126ae-c804-5252-b667-bc1a2d56568b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50919,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KY67GUW/2025-10-31/image/7b01422e-7a94-47bb-a6c4-b5d5429911cf_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': 'Mann Island Finance',
 'title': 'LAND ROVER DISCOVERY DIESEL SW 3.0 TD6 SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 TD6 SE 5dr Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116707815%27 HTTP/1.1" 200 None
2025-11-27 19:07:00 [astonbarclay.gb] INFO: Saving data for 116707815: {'created_time': 1764270420.460762, 'last_price_update_time': 1764270420.460772, 'auction_closing_time': 1764583200.0}
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116707815') HTTP/1.1" 204 0
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d18d690>
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Ff9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe58d90>
2025-11-27 19:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg?w=600 saved to cache
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/f9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e851610>
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252Fd126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/d126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d075850>
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e950590>
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e951f50>
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb86810>
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg?w=600 saved to cache
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/ca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec19b10>
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e847bd0>
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e81b050>
2025-11-27 19:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/16f08e30-dccd-4430-b1d8-539579934dff.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eab2750>
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea69810>
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9129a528-6888-4849-9486-8328c2caf3e7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9129a528-6888-4849-9486-8328c2caf3e7.jpg?w=600 saved to cache
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec8a210>
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec87790>
2025-11-27 19:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252Ff9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/f9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd70610>
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe29a10>
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Ffefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/d7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecfaf10>
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252Fca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/ca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9aa0d0>
2025-11-27 19:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Fc769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d42d350>
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:07:05 [scrapy.extensions.logstats] INFO: Crawled 310 pages (at 26 pages/min), scraped 220 items (at 22 items/min)
2025-11-27 19:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9a9dd0>
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c702510>
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F16f08e30-dccd-4430-b1d8-539579934dff.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/16f08e30-dccd-4430-b1d8-539579934dff.jpg?w=600 saved to cache
2025-11-27 19:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9c702f10>
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec22b90>
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252Fd73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecacb90>
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d4a1490>
2025-11-27 19:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fb26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecc6a10>
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg?w=600 saved to cache
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/c97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue)
2025-11-27 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d18ff50>
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe9bfd0>
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e850c50>
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fd7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/d7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4ba9e658-7d63-453c-9810-15029dac65d2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117512026?view=catalogue)
2025-11-27 19:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd19d10>
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fef7d50>
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg?w=600 saved to cache
2025-11-27 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RO67OER/2025-11-27/image/63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117550047?view=catalogue)
2025-11-27 19:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU71NZB/2025-11-27/image/4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549930?view=catalogue)
2025-11-27 19:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84cb90>
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea68dd0>
2025-11-27 19:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1c5d0>
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb55e10>
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fb72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EF69YKM/2025-11-27/image/dc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117552007?view=catalogue)
2025-11-27 19:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EP19EJE/2025-11-27/image/585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549984?view=catalogue)
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe43b10>
2025-11-27 19:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252Fc97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/c97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e84ca90>
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eca2390>
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCP73FYW%252F2025-11-27%252Fimage%252F066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf408e58-6583-5936-b8d5-dfdd53969545
2025-11-27 19:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf408e58-6583-5936-b8d5-dfdd53969545, skipping ID generation
2025-11-27 19:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf408e58-6583-5936-b8d5-dfdd53969545 with scrape type 1
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bf408e58-6583-5936-b8d5-dfdd53969545 from tracking dictionaries
2025-11-27 19:07:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf408e58-6583-5936-b8d5-dfdd53969545 sending to next pipeline
2025-11-27 19:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bf408e58-6583-5936-b8d5-dfdd53969545, identifier: 117550785
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d30b390>
2025-11-27 19:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117372675?view=catalogue)
2025-11-27 19:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785
2025-11-27 19:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785
2025-11-27 19:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785 to the API
2025-11-27 19:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'bf408e58-6583-5936-b8d5-dfdd53969545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CP73FYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550785',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 4845,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30476,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30671,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28674,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28955,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51974,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48250,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40336,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf408e58-6583-5936-b8d5-dfdd53969545/bf408e58-6583-5936-b8d5-dfdd53969545_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58160,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-19',
 'seller_name': None,
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 N-Connecta 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0 DiG-T 114 N-Connecta 5dr DCT',
 'vin': None,
 'year': 2023}
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550785%27 HTTP/1.1" 200 None
2025-11-27 19:07:12 [astonbarclay.gb] INFO: Saving data for 117550785: {'created_time': 1764270432.539068, 'last_price_update_time': 1764270432.539078}
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550785') HTTP/1.1" 204 0
2025-11-27 19:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec1aa90>
2025-11-27 19:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4ba9e658-7d63-453c-9810-15029dac65d2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4ba9e658-7d63-453c-9810-15029dac65d2.jpg?w=600 saved to cache
2025-11-27 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6
2025-11-27 19:07:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89148e1c-73e2-5710-9d51-7e6fb0de55e6, skipping ID generation
2025-11-27 19:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6 with scrape type 1
2025-11-27 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 89148e1c-73e2-5710-9d51-7e6fb0de55e6 from tracking dictionaries
2025-11-27 19:07:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89148e1c-73e2-5710-9d51-7e6fb0de55e6 sending to next pipeline
2025-11-27 19:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 89148e1c-73e2-5710-9d51-7e6fb0de55e6, identifier: 117512026
2025-11-27 19:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 89148e1c-73e2-5710-9d51-7e6fb0de55e6 with identifier: 117512026
2025-11-27 19:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 89148e1c-73e2-5710-9d51-7e6fb0de55e6 with identifier: 117512026
2025-11-27 19:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 89148e1c-73e2-5710-9d51-7e6fb0de55e6 with identifier: 117512026 to the API
2025-11-27 19:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/4ba9e658-7d63-453c-9810-15029dac65d2.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '89148e1c-73e2-5710-9d51-7e6fb0de55e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO20ULG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117512026',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 75762,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77994,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/4ba9e658-7d63-453c-9810-15029dac65d2.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87953,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/f840c56d-4c92-4c2e-b1f0-7241857ba59f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69429,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/3e6dfa2c-aaa3-498d-8d9a-3dae52d4b273.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101885,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/16f08e30-dccd-4430-b1d8-539579934dff.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83790,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/9129a528-6888-4849-9486-8328c2caf3e7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75510,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/5a4644e7-38ab-4c16-9785-9b9d01d61e17.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96658,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/5159fc05-4cc4-4d48-98b9-1a57bbbd2c8f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89148e1c-73e2-5710-9d51-7e6fb0de55e6/89148e1c-73e2-5710-9d51-7e6fb0de55e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52300,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/67923da5-4d4a-4c42-803a-e52d6dbffd0f.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-24',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A200 AMG Line Executive 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A200 AMG Line Executive 5dr Auto',
 'vin': None,
 'year': 2020}
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117512026%27 HTTP/1.1" 200 None
2025-11-27 19:07:14 [astonbarclay.gb] INFO: Saving data for 117512026: {'created_time': 1764270434.068384, 'last_price_update_time': 1764270434.068393, 'auction_closing_time': 1764756000.0}
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117512026') HTTP/1.1" 204 0
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1e090>
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRO67OER%252F2025-11-27%252Fimage%252F63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RO67OER/2025-11-27/image/63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b275b539-f448-5479-809d-545bcf70c126
2025-11-27 19:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b275b539-f448-5479-809d-545bcf70c126, skipping ID generation
2025-11-27 19:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b275b539-f448-5479-809d-545bcf70c126 with scrape type 1
2025-11-27 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b275b539-f448-5479-809d-545bcf70c126 from tracking dictionaries
2025-11-27 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b275b539-f448-5479-809d-545bcf70c126 sending to next pipeline
2025-11-27 19:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b275b539-f448-5479-809d-545bcf70c126, identifier: 117550047
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec10690>
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd9b050>
2025-11-27 19:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU71NZB%252F2025-11-27%252Fimage%252F4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU71NZB/2025-11-27/image/4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5e2776a-38c8-5d6b-985b-f0add81eff31
2025-11-27 19:07:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5e2776a-38c8-5d6b-985b-f0add81eff31, skipping ID generation
2025-11-27 19:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e2776a-38c8-5d6b-985b-f0add81eff31 with scrape type 1
2025-11-27 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c5e2776a-38c8-5d6b-985b-f0add81eff31 from tracking dictionaries
2025-11-27 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5e2776a-38c8-5d6b-985b-f0add81eff31 sending to next pipeline
2025-11-27 19:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c5e2776a-38c8-5d6b-985b-f0add81eff31, identifier: 117549930
2025-11-27 19:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eca0190>
2025-11-27 19:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252F83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b275b539-f448-5479-809d-545bcf70c126 with identifier: 117550047
2025-11-27 19:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b275b539-f448-5479-809d-545bcf70c126 with identifier: 117550047
2025-11-27 19:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b275b539-f448-5479-809d-545bcf70c126 with identifier: 117550047 to the API
2025-11-27 19:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/RO67OER/2025-11-27/image/63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'b275b539-f448-5479-809d-545bcf70c126',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RO67OER',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550047',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 88499,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29219,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/63f94600-e367-4a2c-bcb9-866ad995159a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24467,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/07d870d9-73b4-4bad-8685-9a9601316969_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29421,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/78703c30-6636-4733-a8c5-6059d1b111b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26251,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/561a8f10-31a2-4c69-a19b-3f9b4e6598b4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29525,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/22bbe2c4-111b-4ed3-84d1-f8004045e113_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49231,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/f9fcb92d-ff6d-49a2-9137-028ce20dd26f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/68646fdc-8dd5-482c-86cd-efbab121ecc0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75024,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/7f8fa9cb-8bf1-40eb-b160-978bbaf1147c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44347,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/801d7a35-6d54-41c3-acbe-42d163680ef3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37913,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/e79c0b85-ed04-43ae-b75d-e1534f67cf59_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41852,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/dcb07058-c164-4671-bab5-118bba2e42d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39351,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/b8bea73f-8e52-421c-a01b-3ef3053cea17_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41891,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/989b1431-41eb-48d1-9f28-e541a18d7afb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b275b539-f448-5479-809d-545bcf70c126/b275b539-f448-5479-809d-545bcf70c126_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33501,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RO67OER/2025-11-27/image/4f84d43e-d2c3-41b9-b602-8ecb970cac69_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-20',
 'seller_name': 'UKCGR',
 'title': 'BMW 3 SERIES SALOON 330e SE 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e SE 4dr Step Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550047%27 HTTP/1.1" 200 None
2025-11-27 19:07:16 [astonbarclay.gb] INFO: Saving data for 117550047: {'created_time': 1764270436.557193, 'last_price_update_time': 1764270436.557205}
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550047') HTTP/1.1" 204 0
2025-11-27 19:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c5e2776a-38c8-5d6b-985b-f0add81eff31 with identifier: 117549930
2025-11-27 19:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c5e2776a-38c8-5d6b-985b-f0add81eff31 with identifier: 117549930
2025-11-27 19:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c5e2776a-38c8-5d6b-985b-f0add81eff31 with identifier: 117549930 to the API
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DU71NZB/2025-11-27/image/4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'c5e2776a-38c8-5d6b-985b-f0add81eff31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DU71NZB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549930',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 22703,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31062,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/4322b2f9-435e-4ab4-95cd-c02f87d4d939_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30953,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/c97973d4-850a-4746-851e-7447b6c47ff8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29764,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/611a22a2-cf59-4270-8747-b61dd23593e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30453,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/7c3e688e-b2cb-4da4-a427-ad5c88834cb2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56713,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/75957897-d5c6-4ee1-8462-b32f8340ae86_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54076,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/19ac7234-123e-4dd1-8dca-03fd8fccc3f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47982,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/06cb4558-556f-4fca-ad8f-0346e9612621_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e2776a-38c8-5d6b-985b-f0add81eff31/c5e2776a-38c8-5d6b-985b-f0add81eff31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60977,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU71NZB/2025-11-27/image/d126adc4-4917-4ab6-ac3d-5ad1d547bab5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seller_name': None,
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.0 DiG-T 114 Tekna 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549930%27 HTTP/1.1" 200 None
2025-11-27 19:07:16 [astonbarclay.gb] INFO: Saving data for 117549930: {'created_time': 1764270436.961897, 'last_price_update_time': 1764270436.961908}
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549930') HTTP/1.1" 204 0
2025-11-27 19:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e954e10>
2025-11-27 19:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEF69YKM%252F2025-11-27%252Fimage%252Fdc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF69YKM/2025-11-27/image/dc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12144cb7-c989-5107-a7c5-1c061d99e408
2025-11-27 19:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12144cb7-c989-5107-a7c5-1c061d99e408, skipping ID generation
2025-11-27 19:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12144cb7-c989-5107-a7c5-1c061d99e408 with scrape type 1
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 12144cb7-c989-5107-a7c5-1c061d99e408 from tracking dictionaries
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12144cb7-c989-5107-a7c5-1c061d99e408 sending to next pipeline
2025-11-27 19:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 12144cb7-c989-5107-a7c5-1c061d99e408, identifier: 117552007
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eca2910>
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252Fae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec88950>
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEP19EJE%252F2025-11-27%252Fimage%252F585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EP19EJE/2025-11-27/image/585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d01f3068-611b-5e9f-a42d-09c4b4559cf1
2025-11-27 19:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d01f3068-611b-5e9f-a42d-09c4b4559cf1, skipping ID generation
2025-11-27 19:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d01f3068-611b-5e9f-a42d-09c4b4559cf1 with scrape type 1
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d01f3068-611b-5e9f-a42d-09c4b4559cf1 from tracking dictionaries
2025-11-27 19:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d01f3068-611b-5e9f-a42d-09c4b4559cf1 sending to next pipeline
2025-11-27 19:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d01f3068-611b-5e9f-a42d-09c4b4559cf1, identifier: 117549984
2025-11-27 19:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 12144cb7-c989-5107-a7c5-1c061d99e408 with identifier: 117552007
2025-11-27 19:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 12144cb7-c989-5107-a7c5-1c061d99e408 with identifier: 117552007
2025-11-27 19:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 12144cb7-c989-5107-a7c5-1c061d99e408 with identifier: 117552007 to the API
2025-11-27 19:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EF69YKM/2025-11-27/image/dc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '12144cb7-c989-5107-a7c5-1c061d99e408',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF69YKM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117552007',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 44163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42343,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/dc3d6399-7449-4ab1-b9e5-acc02685205e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43189,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/83564985-1690-44c5-93a1-7f65e2304f76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43095,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b72a50d0-2f84-4a6c-970a-7c9a27f6bba3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43119,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/d7536a0c-5eb4-428a-ac82-7eed1609a76a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45008,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/b26f85e4-e9f8-4c3f-8a27-3620a08969bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53771,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/47559c2f-4741-4b9a-b137-c7b2d2c55147_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47894,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/118f3609-90ed-478b-81fb-2bfde171079c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50289,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/3b76acdc-732f-40b0-ad63-5ac4b32ad751_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52634,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/de211143-d947-4b00-822e-37f05bb444f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12144cb7-c989-5107-a7c5-1c061d99e408/12144cb7-c989-5107-a7c5-1c061d99e408_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55888,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF69YKM/2025-11-27/image/98fb911b-3dc7-4426-a55c-7d332259ae43_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-31',
 'seller_name': 'UKCGR',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo Business Edition Nav 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Business Edition Nav 5dr Auto',
 'vin': None,
 'year': 2020}
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552007%27 HTTP/1.1" 200 None
2025-11-27 19:07:19 [astonbarclay.gb] INFO: Saving data for 117552007: {'created_time': 1764270439.339321, 'last_price_update_time': 1764270439.339331}
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117552007') HTTP/1.1" 204 0
2025-11-27 19:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d01f3068-611b-5e9f-a42d-09c4b4559cf1 with identifier: 117549984
2025-11-27 19:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d01f3068-611b-5e9f-a42d-09c4b4559cf1 with identifier: 117549984
2025-11-27 19:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d01f3068-611b-5e9f-a42d-09c4b4559cf1 with identifier: 117549984 to the API
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EP19EJE/2025-11-27/image/585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'd01f3068-611b-5e9f-a42d-09c4b4559cf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EP19EJE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549984',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MAZDA',
 'model': 'CX-3 HATCHBACK SPECIAL EDITION',
 'odometer': 21406,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39080,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/585ceaa7-3226-444b-92f4-db0874d1b598_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40958,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/17564e9d-3e09-432d-ab74-10b0d419fc0b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36480,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/66f3f4c7-7636-4400-bf4e-8bb84a43ce09_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33467,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/2f3acbb4-7dea-4f1f-97e8-99b948ed4995_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46514,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/8d763ba5-28a5-46b0-a78d-1d64a69894a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38655,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/ca80b4a2-0d45-4d00-b99f-99b4048cde0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40802,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/4e2df532-f0c7-4f9f-b011-ac9c439e8d41_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78800,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/596565ba-4806-43d7-b5e8-f3bc2f784d42_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48849,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/23acd02e-db28-490c-b235-acb23df75767_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01f3068-611b-5e9f-a42d-09c4b4559cf1/d01f3068-611b-5e9f-a42d-09c4b4559cf1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77645,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/EP19EJE/2025-11-27/image/0d7747b6-fab0-42d4-a314-ddd15aff9595_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seller_name': 'UKCGR',
 'title': 'MAZDA CX-3 HATCHBACK SPECIAL EDITION 2.0 GT Sport Nav + 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 GT Sport Nav + 5dr Auto',
 'vin': None,
 'year': 2019}
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549984%27 HTTP/1.1" 200 None
2025-11-27 19:07:19 [astonbarclay.gb] INFO: Saving data for 117549984: {'created_time': 1764270439.730225, 'last_price_update_time': 1764270439.730236}
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549984') HTTP/1.1" 204 0
2025-11-27 19:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea5aa10>
2025-11-27 19:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOE22MVT%252F2025-11-26%252Fimage%252F0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff30395e-c4b6-586d-9d9b-312820f1a625
2025-11-27 19:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff30395e-c4b6-586d-9d9b-312820f1a625, skipping ID generation
2025-11-27 19:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff30395e-c4b6-586d-9d9b-312820f1a625 with scrape type 1
2025-11-27 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ff30395e-c4b6-586d-9d9b-312820f1a625 from tracking dictionaries
2025-11-27 19:07:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff30395e-c4b6-586d-9d9b-312820f1a625 sending to next pipeline
2025-11-27 19:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ff30395e-c4b6-586d-9d9b-312820f1a625, identifier: 117372675
2025-11-27 19:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ff30395e-c4b6-586d-9d9b-312820f1a625 with identifier: 117372675
2025-11-27 19:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ff30395e-c4b6-586d-9d9b-312820f1a625 with identifier: 117372675
2025-11-27 19:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 10, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'polestar 2 fastback 165kw 64kwh standard range single motor 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 35469, 'odometer_reading_unit': 'mi', 'registration_date': '2022-06-27', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117372675', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '165kw 64kwh standard range single motor 5dr auto', 'license_plate': 'oe22mvt', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ff30395e-c4b6-586d-9d9b-312820f1a625', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24779}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 26872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 21672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41192}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 36705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 37629}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40199}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 51457}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 57081}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'ff30395e-c4b6-586d-9d9b-312820f1a625',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe22mvt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117372675',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 35469,
     'odometer_in_km': 57081,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24497,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24779,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24758,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26872,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21672,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41192,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36705,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37629,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40199,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51457,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-27',
     'sanitized_make': 'polestar',
     'seller_name': 'zenith',
     'title': 'polestar 2 fastback 165kw 64kwh standard range single motor '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '165kw 64kwh standard range single motor 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: ff30395e-c4b6-586d-9d9b-312820f1a625 spider: astonbarclay.gb
2025-11-27 19:07:20 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ff30395e-c4b6-586d-9d9b-312820f1a625 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 10, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'polestar 2 fastback 165kw 64kwh standard range single motor 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'polestar', 'model': '2 fastback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 35469, 'odometer_reading_unit': 'mi', 'registration_date': '2022-06-27', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117372675', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '165kw 64kwh standard range single motor 5dr auto', 'license_plate': 'oe22mvt', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'ff30395e-c4b6-586d-9d9b-312820f1a625', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24779}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 24758}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 26872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 21672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 41192}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 36705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 37629}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 40199}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600', 'Width': 600, 'Height': 338, 'Extension': 'jpg', 'FileSizeInBytes': 51457}], 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'polestar 2 fastback', 'sanitized_make': 'polestar', 'odometer_in_km': 57081}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'ff30395e-c4b6-586d-9d9b-312820f1a625',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'oe22mvt',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117372675',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'polestar',
     'make_model': 'polestar 2 fastback',
     'model': '2 fastback',
     'odometer': 35469,
     'odometer_in_km': 57081,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24497,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24779,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 24758,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 26872,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 21672,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41192,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36705,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37629,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40199,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51457,
                 'Height': 338,
                 'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-27',
     'sanitized_make': 'polestar',
     'seller_name': 'zenith',
     'title': 'polestar 2 fastback 165kw 64kwh standard range single motor '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '165kw 64kwh standard range single motor 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'ff30395e-c4b6-586d-9d9b-312820f1a625',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OE22MVT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117372675',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'POLESTAR',
 'model': '2 FASTBACK',
 'odometer': 35469,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24497,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/41820f32-6def-4266-a910-37f66fdc0b4e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24779,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/0b0430bb-7d70-4ca5-ba27-c68af2d8c7f0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24758,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/ae197832-d0d3-460c-a39d-42bb2b9ef140_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26872,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/bb0b4fd0-414c-4780-97e7-72801ccb9bc1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21672,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/98ca6869-4d2f-4c45-8c65-ae9de57fcda7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41192,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/2145e4b4-45e7-47f3-aaa6-539e298a333c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36705,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/c3b1f3c7-7e48-49f5-a4cd-200db18ccdf9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37629,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/8baba1dc-c007-47b8-94fe-18a613873ccc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40199,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/95680087-d4cc-471e-bfa9-4607437e4150_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff30395e-c4b6-586d-9d9b-312820f1a625/ff30395e-c4b6-586d-9d9b-312820f1a625_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51457,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/OE22MVT/2025-11-26/image/e9ac9420-6860-4e39-ad1d-286720faaf2e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seller_name': 'Zenith',
 'title': 'POLESTAR 2 FASTBACK 165kW 64kWh Standard Range Single motor 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '165kW 64kWh Standard Range Single motor 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372675%27 HTTP/1.1" 200 None
2025-11-27 19:07:20 [astonbarclay.gb] INFO: Saving data for 117372675: {'created_time': 1764270440.30752, 'last_price_update_time': 1764270440.307531, 'auction_closing_time': 1764323100.0}
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117372675') HTTP/1.1" 204 0
2025-11-27 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117405574?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117405574, 'registration': 'DE23WUC', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2000, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DE23WUC/2025-11-25/image/87ab714c-61eb-409a-82e8-d0d146426e4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/0fbafc25-d182-4844-bbb3-ed9d81661813_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/6c1a048e-76bb-4724-bd17-eadd36178712_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/0da325de-fc56-4283-b1e1-98450d9edb64_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/64d17bfe-7962-4176-80d5-4a1faba39c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/da9a3303-242b-4499-94ac-ba8097a204e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/0276250a-174d-492a-b448-62db8056e11c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/f51fd86c-46f2-46ec-8cd2-3b3749bdf78e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/b232157b-2599-4f87-af4e-0ecf45579618_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/b3e08e63-26e6-4a44-acd0-ccb2e60c2b56_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/25-17k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1265a8b6-18d0-48a0-895d-3558143db902.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117405574, 'registration': 'DE23WUC', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2000, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DE23WUC/2025-11-25/image/87ab714c-61eb-409a-82e8-d0d146426e4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/0fbafc25-d182-4844-bbb3-ed9d81661813_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/6c1a048e-76bb-4724-bd17-eadd36178712_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/0da325de-fc56-4283-b1e1-98450d9edb64_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/64d17bfe-7962-4176-80d5-4a1faba39c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/da9a3303-242b-4499-94ac-ba8097a204e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/0276250a-174d-492a-b448-62db8056e11c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/f51fd86c-46f2-46ec-8cd2-3b3749bdf78e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/b232157b-2599-4f87-af4e-0ecf45579618_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE23WUC/2025-11-25/image/b3e08e63-26e6-4a44-acd0-ccb2e60c2b56_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/25-17k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1265a8b6-18d0-48a0-895d-3558143db902.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad7ae72f-9c24-546a-9121-5d7edd9cf8b8 with identifier: 117405574
2025-11-27 19:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad7ae72f-9c24-546a-9121-5d7edd9cf8b8 with scrape type 2
2025-11-27 19:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad7ae72f-9c24-546a-9121-5d7edd9cf8b8 with scrape type 2
2025-11-27 19:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ad7ae72f-9c24-546a-9121-5d7edd9cf8b8, identifier: 117405574
2025-11-27 19:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ad7ae72f-9c24-546a-9121-5d7edd9cf8b8 with identifier: 117405574
2025-11-27 19:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ad7ae72f-9c24-546a-9121-5d7edd9cf8b8 with identifier: 117405574
2025-11-27 19:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ad7ae72f-9c24-546a-9121-5d7edd9cf8b8 with identifier: 117405574 to the API
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ad7ae72f-9c24-546a-9121-5d7edd9cf8b8%27 HTTP/1.1" 200 None
2025-11-27 19:07:20 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ad7ae72f-9c24-546a-9121-5d7edd9cf8b8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:20 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117405574?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ad7ae72f-9c24-546a-9121-5d7edd9cf8b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DE23WUC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405574',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 21987,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405574%27 HTTP/1.1" 200 None
2025-11-27 19:07:20 [astonbarclay.gb] INFO: Saving data for 117405574: {'auction_closing_time': 1764583200.0, 'created_time': 1764054100.221708, 'last_price_update_time': 1764270440.844333}
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405574') HTTP/1.1" 204 0
2025-11-27 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117182764?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116792783?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117290404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117182764, 'registration': 'EA22UJK', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.4 Boosterjet 48V Hybrid SZ-T 5dr', 'mileage': 26445, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2773, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA22UJK/2025-11-26/image/453b3d43-dcc2-407c-b916-b7397742041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/36b11eee-fdb8-48f8-b128-ec279c7addd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/4593224d-1ecc-4bd1-b28e-820bb50b4c85_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/bd2adafa-7a48-4430-9110-1b597401e9fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/f89f78ff-fb6b-4504-84bc-45875565e88c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/e46bf79a-7e44-4fa3-9414-40f9ec483bb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/76579c35-4511-4ac4-ae7b-de510f4021ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/5be9deca-b901-421f-b1e1-11820aed002e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/23 11K - 08/24 22K', 'remarks': 'VOSA STATES, 24K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/78f52a52-0788-4f80-b679-e59c2ebc79a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117182764, 'registration': 'EA22UJK', 'account': 'MOT070', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.4 Boosterjet 48V Hybrid SZ-T 5dr', 'mileage': 26445, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2773, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Petrol', 'motExpiry': '2026-06-02', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA22UJK/2025-11-26/image/453b3d43-dcc2-407c-b916-b7397742041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/36b11eee-fdb8-48f8-b128-ec279c7addd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/4593224d-1ecc-4bd1-b28e-820bb50b4c85_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/bd2adafa-7a48-4430-9110-1b597401e9fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/f89f78ff-fb6b-4504-84bc-45875565e88c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/e46bf79a-7e44-4fa3-9414-40f9ec483bb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/76579c35-4511-4ac4-ae7b-de510f4021ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22UJK/2025-11-26/image/5be9deca-b901-421f-b1e1-11820aed002e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/23 11K - 08/24 22K', 'remarks': 'VOSA STATES, 24K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/78f52a52-0788-4f80-b679-e59c2ebc79a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99cfa394-c56f-55a9-8f37-902fd34ef653 with identifier: 117182764
2025-11-27 19:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99cfa394-c56f-55a9-8f37-902fd34ef653 with scrape type 2
2025-11-27 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99cfa394-c56f-55a9-8f37-902fd34ef653 with scrape type 2
2025-11-27 19:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 99cfa394-c56f-55a9-8f37-902fd34ef653, identifier: 117182764
2025-11-27 19:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 99cfa394-c56f-55a9-8f37-902fd34ef653 with identifier: 117182764
2025-11-27 19:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 99cfa394-c56f-55a9-8f37-902fd34ef653 with identifier: 117182764
2025-11-27 19:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 99cfa394-c56f-55a9-8f37-902fd34ef653 with identifier: 117182764 to the API
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2799cfa394-c56f-55a9-8f37-902fd34ef653%27 HTTP/1.1" 200 None
2025-11-27 19:07:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 99cfa394-c56f-55a9-8f37-902fd34ef653: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:20 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117182764?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '99cfa394-c56f-55a9-8f37-902fd34ef653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA22UJK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117182764',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SUZUKI',
 'model': 'VITARA ESTATE',
 'odometer': 26445,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seller_name': 'Motability Operations',
 'title': 'SUZUKI VITARA ESTATE 1.4 Boosterjet 48V Hybrid SZ-T 5dr',
 'transmission': 'manual',
 'trim': '1.4 Boosterjet 48V Hybrid SZ-T 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117182764%27 HTTP/1.1" 200 None
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Saving data for 117182764: {'auction_closing_time': 1764583200.0, 'created_time': 1762974202.914153, 'last_price_update_time': 1764270441.416173}
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117182764') HTTP/1.1" 204 0
2025-11-27 19:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117169584?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117443695?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116792783, 'registration': 'KV73JDU', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid GR Sport 5dr CVT', 'mileage': 39405, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2700, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-09-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KV73JDU/2025-11-06/image/308697bf-5cee-4a58-a8da-cc73ce2c5fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/56ba80f2-16fc-4d2b-9104-170c2faba207_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/17674d07-b937-4c1b-aa27-909d8ec29bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/880d47e9-7475-41c2-9d4f-c73f5c70345f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/1dbd26ac-1b55-45c0-9d94-ded1c73acd29_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/1faae8c6-4785-406b-9f03-1a196ffdec37_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/c53c649e-e53d-4875-82b0-1a67e0b97b5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/383d05aa-e232-460d-b40b-b0c936d4982b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/25 33K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ef121b99-1f25-495f-b1c2-3a40ecb27e9e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116792783, 'registration': 'KV73JDU', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid GR Sport 5dr CVT', 'mileage': 39405, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2700, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-09-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KV73JDU/2025-11-06/image/308697bf-5cee-4a58-a8da-cc73ce2c5fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/56ba80f2-16fc-4d2b-9104-170c2faba207_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/17674d07-b937-4c1b-aa27-909d8ec29bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/880d47e9-7475-41c2-9d4f-c73f5c70345f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/1dbd26ac-1b55-45c0-9d94-ded1c73acd29_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/1faae8c6-4785-406b-9f03-1a196ffdec37_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/c53c649e-e53d-4875-82b0-1a67e0b97b5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KV73JDU/2025-11-06/image/383d05aa-e232-460d-b40b-b0c936d4982b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/25 33K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ef121b99-1f25-495f-b1c2-3a40ecb27e9e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec5b62e-2afb-527b-a911-13e16cdc383c with identifier: 116792783
2025-11-27 19:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec5b62e-2afb-527b-a911-13e16cdc383c with scrape type 2
2025-11-27 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aec5b62e-2afb-527b-a911-13e16cdc383c with scrape type 2
2025-11-27 19:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aec5b62e-2afb-527b-a911-13e16cdc383c, identifier: 116792783
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117290404, 'registration': 'VO19KMV', 'account': 'STA058', 'make': 'VAUXHALL', 'model': 'INSIGNIA GRAND SPORT', 'derivative': '1.5T SRi Vx-line Nav 5dr', 'mileage': 68182, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2800, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VO19KMV/2025-11-19/image/d6d7aa7f-b0a0-4123-af4c-55ff3149302e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/4fc85fec-48ae-4e76-91d5-2ba8478e3343_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/a4f2ad09-0542-4280-aa17-b694043349a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/cc6ff28e-a399-45c5-962b-579c337edfa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/248d3910-20aa-4654-a118-5c7cb5afcfae_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/36d9fa0c-80aa-48fb-8c7e-bfd12d27234b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/c6e6f541-820b-45b5-8294-1767eb85a143_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/f9a342c1-cfdf-4219-b709-abd840b0acaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/115e0218-81b0-454a-b192-4447f6ccdd75_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/1a290677-a8cc-4a6b-a3cc-a2ddec9a1afa_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/23-64K 06/24-65K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 63K 64K 66K 67K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/176d2961-55b1-4dc1-97db-64eac166b1b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117290404, 'registration': 'VO19KMV', 'account': 'STA058', 'make': 'VAUXHALL', 'model': 'INSIGNIA GRAND SPORT', 'derivative': '1.5T SRi Vx-line Nav 5dr', 'mileage': 68182, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2800, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VO19KMV/2025-11-19/image/d6d7aa7f-b0a0-4123-af4c-55ff3149302e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/4fc85fec-48ae-4e76-91d5-2ba8478e3343_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/a4f2ad09-0542-4280-aa17-b694043349a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/cc6ff28e-a399-45c5-962b-579c337edfa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/248d3910-20aa-4654-a118-5c7cb5afcfae_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/36d9fa0c-80aa-48fb-8c7e-bfd12d27234b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/c6e6f541-820b-45b5-8294-1767eb85a143_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/f9a342c1-cfdf-4219-b709-abd840b0acaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/115e0218-81b0-454a-b192-4447f6ccdd75_removebg.jpg?w=600', 'https://abimg003.imgix.net/VO19KMV/2025-11-19/image/1a290677-a8cc-4a6b-a3cc-a2ddec9a1afa_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/23-64K 06/24-65K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 63K 64K 66K 67K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/176d2961-55b1-4dc1-97db-64eac166b1b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: becdba56-a40f-5e09-af10-25a9449e634b with identifier: 117290404
2025-11-27 19:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item becdba56-a40f-5e09-af10-25a9449e634b with scrape type 2
2025-11-27 19:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item becdba56-a40f-5e09-af10-25a9449e634b with scrape type 2
2025-11-27 19:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: becdba56-a40f-5e09-af10-25a9449e634b, identifier: 117290404
2025-11-27 19:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aec5b62e-2afb-527b-a911-13e16cdc383c with identifier: 116792783
2025-11-27 19:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aec5b62e-2afb-527b-a911-13e16cdc383c with identifier: 116792783
2025-11-27 19:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aec5b62e-2afb-527b-a911-13e16cdc383c with identifier: 116792783 to the API
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116792783?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'aec5b62e-2afb-527b-a911-13e16cdc383c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KV73JDU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116792783',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'YARIS HATCHBACK',
 'odometer': 39405,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-20',
 'seller_name': 'Motability Operations',
 'title': 'TOYOTA YARIS HATCHBACK 1.5 Hybrid GR Sport 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid GR Sport 5dr CVT',
 'vin': None,
 'year': 2023}
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116792783%27 HTTP/1.1" 200 None
2025-11-27 19:07:21 [astonbarclay.gb] INFO: Saving data for 116792783: {'auction_closing_time': 1764583200.0, 'created_time': 1763579025.680475, 'last_price_update_time': 1764270441.874467}
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116792783') HTTP/1.1" 204 0
2025-11-27 19:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: becdba56-a40f-5e09-af10-25a9449e634b with identifier: 117290404
2025-11-27 19:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: becdba56-a40f-5e09-af10-25a9449e634b with identifier: 117290404
2025-11-27 19:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: becdba56-a40f-5e09-af10-25a9449e634b with identifier: 117290404 to the API
2025-11-27 19:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27becdba56-a40f-5e09-af10-25a9449e634b%27 HTTP/1.1" 200 None
2025-11-27 19:07:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id becdba56-a40f-5e09-af10-25a9449e634b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117290404?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'becdba56-a40f-5e09-af10-25a9449e634b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VO19KMV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117290404',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA GRAND SPORT',
 'odometer': 68182,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'VAUXHALL INSIGNIA GRAND SPORT 1.5T SRi Vx-line Nav 5dr',
 'transmission': 'manual',
 'trim': '1.5T SRi Vx-line Nav 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290404%27 HTTP/1.1" 200 None
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Saving data for 117290404: {'auction_closing_time': 1764583200.0, 'created_time': 1763492835.149916, 'last_price_update_time': 1764270442.159081}
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117290404') HTTP/1.1" 204 0
2025-11-27 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117405473?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116872991?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117169584, 'registration': 'EG18NMM', 'account': 'STA058', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 5dr', 'mileage': 41300, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2803, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-08-24', 'fuel': 'Petrol', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EG18NMM/2025-11-13/image/62956ac3-f960-4591-a411-e9f53b13840e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/57cef841-e2ca-44f3-ba4f-80f7737e7b04_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/f6b0a91f-6f66-44c2-9a4b-1134ff3fff31_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/c162e74d-4d20-470e-9e04-3664d6acefb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/5405f364-497b-4451-adf2-c120196b4caf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/a4841129-fc62-40eb-99eb-8ce64d444eb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/7e92243a-fde5-4758-abce-ad1fa5cc1574_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/2f426c3b-d0d2-42e3-948e-0ffb85fd4059_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0176442-a48e-432b-8d01-ba6fbaa5575c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117169584, 'registration': 'EG18NMM', 'account': 'STA058', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 5dr', 'mileage': 41300, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2803, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-08-24', 'fuel': 'Petrol', 'motExpiry': '2026-08-07', 'doors': 5, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EG18NMM/2025-11-13/image/62956ac3-f960-4591-a411-e9f53b13840e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/57cef841-e2ca-44f3-ba4f-80f7737e7b04_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/f6b0a91f-6f66-44c2-9a4b-1134ff3fff31_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/c162e74d-4d20-470e-9e04-3664d6acefb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/5405f364-497b-4451-adf2-c120196b4caf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/a4841129-fc62-40eb-99eb-8ce64d444eb2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/7e92243a-fde5-4758-abce-ad1fa5cc1574_removebg.jpg?w=600', 'https://abimg003.imgix.net/EG18NMM/2025-11-13/image/2f426c3b-d0d2-42e3-948e-0ffb85fd4059_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0176442-a48e-432b-8d01-ba6fbaa5575c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fab6f905-d4b0-5b39-b230-448f031650e7 with identifier: 117169584
2025-11-27 19:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fab6f905-d4b0-5b39-b230-448f031650e7 with scrape type 2
2025-11-27 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fab6f905-d4b0-5b39-b230-448f031650e7 with scrape type 2
2025-11-27 19:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fab6f905-d4b0-5b39-b230-448f031650e7, identifier: 117169584
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117443695, 'registration': 'DV18CKC', 'account': 'STA058', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV 4h 5dr Auto', 'mileage': 46112, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2802, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-02', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV18CKC/2025-11-25/image/78884b44-9dec-4a38-8c53-8afc7751ee3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/0b7838d7-4550-46d7-b684-c51c36fff2d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/4f49f992-dc04-4422-8768-c0132c4d7f2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/42158992-a44b-4cb2-89b2-1a1d412d30f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/62ecf5f6-ca42-4bf9-a8ef-8a14337b6e20_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/25347d96-fd07-4ec3-96a9-514b4520e05c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/264ed61c-499a-479e-8d45-390e04fb92ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/8c1de9c3-340f-4498-b6d6-52931f0edd32_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 23K 28K 43K 45K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26001b7c-70bf-4e96-89cd-4b5fcac7d951.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117443695, 'registration': 'DV18CKC', 'account': 'STA058', 'make': 'MITSUBISHI', 'model': 'OUTLANDER ESTATE', 'derivative': '2.0 PHEV 4h 5dr Auto', 'mileage': 46112, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2802, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-27', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-02', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DV18CKC/2025-11-25/image/78884b44-9dec-4a38-8c53-8afc7751ee3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/0b7838d7-4550-46d7-b684-c51c36fff2d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/4f49f992-dc04-4422-8768-c0132c4d7f2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/42158992-a44b-4cb2-89b2-1a1d412d30f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/62ecf5f6-ca42-4bf9-a8ef-8a14337b6e20_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/25347d96-fd07-4ec3-96a9-514b4520e05c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/264ed61c-499a-479e-8d45-390e04fb92ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV18CKC/2025-11-25/image/8c1de9c3-340f-4498-b6d6-52931f0edd32_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 23K 28K 43K 45K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26001b7c-70bf-4e96-89cd-4b5fcac7d951.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282311c4-1f4d-5f3f-b0ba-dda6c700caa1 with identifier: 117443695
2025-11-27 19:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282311c4-1f4d-5f3f-b0ba-dda6c700caa1 with scrape type 2
2025-11-27 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282311c4-1f4d-5f3f-b0ba-dda6c700caa1 with scrape type 2
2025-11-27 19:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 282311c4-1f4d-5f3f-b0ba-dda6c700caa1, identifier: 117443695
2025-11-27 19:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fab6f905-d4b0-5b39-b230-448f031650e7 with identifier: 117169584
2025-11-27 19:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fab6f905-d4b0-5b39-b230-448f031650e7 with identifier: 117169584
2025-11-27 19:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fab6f905-d4b0-5b39-b230-448f031650e7 with identifier: 117169584 to the API
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fab6f905-d4b0-5b39-b230-448f031650e7%27 HTTP/1.1" 200 None
2025-11-27 19:07:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fab6f905-d4b0-5b39-b230-448f031650e7: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117169584?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fab6f905-d4b0-5b39-b230-448f031650e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EG18NMM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117169584',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 41300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-24',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'FORD FIESTA HATCHBACK 1.1 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.1 Zetec 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117169584%27 HTTP/1.1" 200 None
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Saving data for 117169584: {'auction_closing_time': 1764583200.0, 'created_time': 1762974203.20747, 'last_price_update_time': 1764270442.663242}
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117169584') HTTP/1.1" 204 0
2025-11-27 19:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 282311c4-1f4d-5f3f-b0ba-dda6c700caa1 with identifier: 117443695
2025-11-27 19:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 282311c4-1f4d-5f3f-b0ba-dda6c700caa1 with identifier: 117443695
2025-11-27 19:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 282311c4-1f4d-5f3f-b0ba-dda6c700caa1 with identifier: 117443695 to the API
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27282311c4-1f4d-5f3f-b0ba-dda6c700caa1%27 HTTP/1.1" 200 None
2025-11-27 19:07:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 282311c4-1f4d-5f3f-b0ba-dda6c700caa1: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117443695?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '282311c4-1f4d-5f3f-b0ba-dda6c700caa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DV18CKC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117443695',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER ESTATE',
 'odometer': 46112,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'MITSUBISHI OUTLANDER ESTATE 2.0 PHEV 4h 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 PHEV 4h 5dr Auto',
 'vin': None,
 'year': 2018}
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117443695%27 HTTP/1.1" 200 None
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Saving data for 117443695: {'auction_closing_time': 1764583200.0, 'created_time': 1764054088.375094, 'last_price_update_time': 1764270442.953349}
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117443695') HTTP/1.1" 204 0
2025-11-27 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131550?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117269311?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131446?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2005, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': '**STARTS & RUNS BUT INTERMITTEN EML ILLUMINATED - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2005, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': '**STARTS & RUNS BUT INTERMITTEN EML ILLUMINATED - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-11-27 19:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-11-27 19:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-11-27 19:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0e3e9c6c-f246-5405-ac96-76e6a1737954, identifier: 117207188
2025-11-27 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117405473, 'registration': 'DC23JRX', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19017, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2001, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JRX/2025-11-25/image/302e3c14-6742-4db6-9c1d-e726caaf3f06_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/ca4332dd-78d6-46e3-8431-40fab6bf6b2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/1607c34c-3559-4864-bc2c-33721d3461a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/8bd2841a-c55c-4e81-bccd-62b6c61fe11d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/95510f24-6cbc-4487-afd2-dd454e701454_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/804f777b-a6d6-48b0-ac3e-379307a3a93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/7b312e16-7ad1-483b-8811-7930aeb61752_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/a9aa1ea5-222d-4cb7-9116-e7458bacd632_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/4dc294ec-cae2-4b0b-a0ae-ca962774dec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/9c72d33f-077f-4df7-aaaa-243a7e6b6c9b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33843d79-7b28-4956-84d1-f956085395dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117405473, 'registration': 'DC23JRX', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19017, 'mileageWarranty': True, 'type': 'car', 'saleId': 17828, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 442}, 'saleStart': '2025-12-01T10:00Z', 'lot': 2001, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JRX/2025-11-25/image/302e3c14-6742-4db6-9c1d-e726caaf3f06_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/ca4332dd-78d6-46e3-8431-40fab6bf6b2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/1607c34c-3559-4864-bc2c-33721d3461a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/8bd2841a-c55c-4e81-bccd-62b6c61fe11d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/95510f24-6cbc-4487-afd2-dd454e701454_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/804f777b-a6d6-48b0-ac3e-379307a3a93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/7b312e16-7ad1-483b-8811-7930aeb61752_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/a9aa1ea5-222d-4cb7-9116-e7458bacd632_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/4dc294ec-cae2-4b0b-a0ae-ca962774dec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JRX/2025-11-25/image/9c72d33f-077f-4df7-aaaa-243a7e6b6c9b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33843d79-7b28-4956-84d1-f956085395dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 975a1348-594f-554d-b46b-38ce8ea421a8 with identifier: 117405473
2025-11-27 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975a1348-594f-554d-b46b-38ce8ea421a8 with scrape type 2
2025-11-27 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 975a1348-594f-554d-b46b-38ce8ea421a8 with scrape type 2
2025-11-27 19:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 975a1348-594f-554d-b46b-38ce8ea421a8, identifier: 117405473
2025-11-27 19:07:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116872991, 'registration': 'BW16TOA', 'account': 'KEN008', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.2 TCE Signature Nav 5dr', 'mileage': 48677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 85, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BW16TOA/2025-11-04/image/5691f1bd-a6c8-4b3d-b521-aa2f3379b2fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/09e55a75-6f98-4b55-acc3-0d705d17ba37_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/243d3efb-9900-4092-a743-2ab03f79bc63_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/e0438b78-90ae-427d-8d28-7094897a52a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/05064470-15c5-4734-9863-c1091e83ceb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/2d6bd1b0-8830-415d-ac3a-8d91ce849bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/eb70254e-8ccd-4275-b212-6b197fa97f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/847cd4df-db7f-473d-a497-398e723c5d8b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 06/17- 9k, 07/18- 15k, 06/19- 21k, 07/20- 25k, 08/21- 30k, 03/23- 37k 05/24- 42k, 07/25- 47k', 'remarks': 'vosa@ 21k, 25k, 29k, 34k, 39k, 43k, 47k spare key', 'virtual': True, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93f243b9-0b05-498b-b47d-252c75779c74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116872991, 'registration': 'BW16TOA', 'account': 'KEN008', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.2 TCE Signature Nav 5dr', 'mileage': 48677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 85, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BW16TOA/2025-11-04/image/5691f1bd-a6c8-4b3d-b521-aa2f3379b2fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/09e55a75-6f98-4b55-acc3-0d705d17ba37_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/243d3efb-9900-4092-a743-2ab03f79bc63_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/e0438b78-90ae-427d-8d28-7094897a52a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/05064470-15c5-4734-9863-c1091e83ceb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/2d6bd1b0-8830-415d-ac3a-8d91ce849bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/eb70254e-8ccd-4275-b212-6b197fa97f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/847cd4df-db7f-473d-a497-398e723c5d8b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 06/17- 9k, 07/18- 15k, 06/19- 21k, 07/20- 25k, 08/21- 30k, 03/23- 37k 05/24- 42k, 07/25- 47k', 'remarks': 'vosa@ 21k, 25k, 29k, 34k, 39k, 43k, 47k spare key', 'virtual': True, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93f243b9-0b05-498b-b47d-252c75779c74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991
2025-11-27 19:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8652913-c531-5e8e-82f7-57af2b0df8ed with scrape type 2
2025-11-27 19:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8652913-c531-5e8e-82f7-57af2b0df8ed with scrape type 2
2025-11-27 19:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8652913-c531-5e8e-82f7-57af2b0df8ed, identifier: 116872991
2025-11-27 19:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-11-27 19:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-11-27 19:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188 to the API
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0e3e9c6c-f246-5405-ac96-76e6a1737954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BU21HYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207188',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK SPECIAL EDITION',
 'odometer': 21876,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'JEEP RENEGADE HATCHBACK SPECIAL EDITION 1.0 T3 GSE Night Eagle II '
          '5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Night Eagle II 5dr',
 'vin': None,
 'year': 2021}
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-11-27 19:07:23 [astonbarclay.gb] INFO: Saving data for 117207188: {'auction_closing_time': 1764583200.0, 'created_time': 1763492568.692688, 'last_price_update_time': 1764270443.567494}
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207188') HTTP/1.1" 204 0
2025-11-27 19:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 975a1348-594f-554d-b46b-38ce8ea421a8 with identifier: 117405473
2025-11-27 19:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 975a1348-594f-554d-b46b-38ce8ea421a8 with identifier: 117405473
2025-11-27 19:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 975a1348-594f-554d-b46b-38ce8ea421a8 with identifier: 117405473 to the API
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27975a1348-594f-554d-b46b-38ce8ea421a8%27 HTTP/1.1" 200 None
2025-11-27 19:07:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 975a1348-594f-554d-b46b-38ce8ea421a8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117405473?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '975a1348-594f-554d-b46b-38ce8ea421a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JRX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405473',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 19017,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405473%27 HTTP/1.1" 200 None
2025-11-27 19:07:23 [astonbarclay.gb] INFO: Saving data for 117405473: {'auction_closing_time': 1764583200.0, 'created_time': 1764054102.352934, 'last_price_update_time': 1764270443.85022}
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405473') HTTP/1.1" 204 0
2025-11-27 19:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991
2025-11-27 19:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991
2025-11-27 19:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991 to the API
2025-11-27 19:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116872991?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f8652913-c531-5e8e-82f7-57af2b0df8ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BW16TOA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116872991',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 48677,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': 'Ken Jervis Kia',
 'title': 'RENAULT KADJAR HATCHBACK 1.2 TCE Signature Nav 5dr',
 'transmission': 'manual',
 'trim': '1.2 TCE Signature Nav 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116872991%27 HTTP/1.1" 200 None
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Saving data for 116872991: {'auction_closing_time': 1764334800.0, 'created_time': 1763492943.189844, 'last_price_update_time': 1764270444.165322}
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116872991') HTTP/1.1" 204 0
2025-11-27 19:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117051310?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131550, 'registration': 'BH19XWJ', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'GRAND C4 SPACETOURER ESTATE (RC)', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 44461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 17, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-08-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f4eff252-fb17-4b3c-a49b-431948aaae35_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f693600e-cd70-4b99-a583-152af9014350_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/cc966adf-816c-4cb4-a223-76af9f6756ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/fb5bb530-683d-4cba-adc5-f4bbc3788d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/79430369-61e5-46fc-b127-3f8342c7041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/5fb27594-c4ef-43c7-9a19-83acc4a28e93_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/98eeb9ce-36b2-456f-9675-a75015b88390_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/413ecfdf-9198-4039-a77f-34a3ad6bd1ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/4b2eee3a-7b32-4756-96f9-ec86fecb9ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/0755e8cb-d879-4ac0-9e87-ae0aee3aede3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/8d8070a8-d31b-4d14-89c4-bd9add7f6c3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/19 4K 12/20 13K 12/21 15K 01/23 22K 04/24 32K 03/25 39K', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb809c2-c6a3-474e-85e4-43507be38cad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131550, 'registration': 'BH19XWJ', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'GRAND C4 SPACETOURER ESTATE (RC)', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 44461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 17, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-08-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f4eff252-fb17-4b3c-a49b-431948aaae35_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f693600e-cd70-4b99-a583-152af9014350_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/cc966adf-816c-4cb4-a223-76af9f6756ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/fb5bb530-683d-4cba-adc5-f4bbc3788d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/79430369-61e5-46fc-b127-3f8342c7041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/5fb27594-c4ef-43c7-9a19-83acc4a28e93_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/98eeb9ce-36b2-456f-9675-a75015b88390_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/413ecfdf-9198-4039-a77f-34a3ad6bd1ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/4b2eee3a-7b32-4756-96f9-ec86fecb9ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/0755e8cb-d879-4ac0-9e87-ae0aee3aede3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/8d8070a8-d31b-4d14-89c4-bd9add7f6c3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/19 4K 12/20 13K 12/21 15K 01/23 22K 04/24 32K 03/25 39K', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb809c2-c6a3-474e-85e4-43507be38cad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-11-27 19:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16b1caf-3652-5871-a205-1b3f29f09607 with scrape type 2
2025-11-27 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e16b1caf-3652-5871-a205-1b3f29f09607 with scrape type 2
2025-11-27 19:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e16b1caf-3652-5871-a205-1b3f29f09607, identifier: 117131550
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117269311, 'registration': 'MF69JZG', 'account': 'BSM001', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 FR [EZ] 5dr DSG', 'mileage': 53292, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 84, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-04', 'fuel': 'Petrol', 'motExpiry': '2026-09-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MF69JZG/2025-11-19/image/a599f01b-7e0c-4c6c-9df8-2858b4b17292_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/e6e25ef9-1650-4c88-941e-96db0ba27f1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/4202afcc-2731-44e6-98d7-80daf55d3abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/aabba8f5-54d0-4a6b-9ac0-294b5884db23_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/37f8c6ce-1c33-4862-a33a-f863a11d0e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/c00eecbb-b3f4-4d1f-b2db-9941e09aeb26_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/1da3bb12-98cc-4547-8fa9-fba246d7caf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/801e9d8f-1875-4900-a9df-20cfcebef183_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa @ 45k 49k 51k 53k sd card', 'virtual': True, 'seller': 'BS Marson Fiat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1419a4c7-d8db-4cf5-8c11-64e67568b232.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117269311, 'registration': 'MF69JZG', 'account': 'BSM001', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 FR [EZ] 5dr DSG', 'mileage': 53292, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 84, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-04', 'fuel': 'Petrol', 'motExpiry': '2026-09-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MF69JZG/2025-11-19/image/a599f01b-7e0c-4c6c-9df8-2858b4b17292_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/e6e25ef9-1650-4c88-941e-96db0ba27f1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/4202afcc-2731-44e6-98d7-80daf55d3abe_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/aabba8f5-54d0-4a6b-9ac0-294b5884db23_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/37f8c6ce-1c33-4862-a33a-f863a11d0e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/c00eecbb-b3f4-4d1f-b2db-9941e09aeb26_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/1da3bb12-98cc-4547-8fa9-fba246d7caf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MF69JZG/2025-11-19/image/801e9d8f-1875-4900-a9df-20cfcebef183_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa @ 45k 49k 51k 53k sd card', 'virtual': True, 'seller': 'BS Marson Fiat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1419a4c7-d8db-4cf5-8c11-64e67568b232.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2965a328-d788-5390-81b9-bc8fb1007771 with identifier: 117269311
2025-11-27 19:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2965a328-d788-5390-81b9-bc8fb1007771 with scrape type 2
2025-11-27 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2965a328-d788-5390-81b9-bc8fb1007771 with scrape type 2
2025-11-27 19:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2965a328-d788-5390-81b9-bc8fb1007771, identifier: 117269311
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131446, 'registration': 'MV20KJO', 'account': 'WIL004', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Performance AWD 4dr [Performance Upgrade] Auto', 'mileage': 95232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 18, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-07', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV20KJO/2025-11-17/image/b102b27e-6f98-4242-a1e9-2f2908dcb728_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/faa48bbf-32e3-46cd-9f96-27cf2273a2c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/7406a0ad-e4b0-4b86-9cd3-76c24ba64801_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/db2f2ab1-e95f-4f2d-97d8-18efa2349584_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/43ffac0c-09a6-479b-8065-79b269a9f2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/743407a9-8c79-4f68-9a86-9649c0dbe0e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/77576649-d0d5-457c-b82b-2ae6e60cfd5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/3cc0635e-e764-4a90-81de-f3c485d5ed5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c12ca258-c37c-45ed-b365-a6226078d822_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c6414832-9f50-40b7-9be9-8a03befd5057_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/99dfce62-0286-4635-b86e-094324d935fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/ffe248b1-e140-46fe-8fa1-e35a320b63df_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c717-2d19-4b17-8b97-00dfc5a80826.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131446, 'registration': 'MV20KJO', 'account': 'WIL004', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Performance AWD 4dr [Performance Upgrade] Auto', 'mileage': 95232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 18, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-07', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV20KJO/2025-11-17/image/b102b27e-6f98-4242-a1e9-2f2908dcb728_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/faa48bbf-32e3-46cd-9f96-27cf2273a2c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/7406a0ad-e4b0-4b86-9cd3-76c24ba64801_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/db2f2ab1-e95f-4f2d-97d8-18efa2349584_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/43ffac0c-09a6-479b-8065-79b269a9f2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/743407a9-8c79-4f68-9a86-9649c0dbe0e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/77576649-d0d5-457c-b82b-2ae6e60cfd5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/3cc0635e-e764-4a90-81de-f3c485d5ed5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c12ca258-c37c-45ed-b365-a6226078d822_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c6414832-9f50-40b7-9be9-8a03befd5057_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/99dfce62-0286-4635-b86e-094324d935fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/ffe248b1-e140-46fe-8fa1-e35a320b63df_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c717-2d19-4b17-8b97-00dfc5a80826.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-11-27 19:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with scrape type 2
2025-11-27 19:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with scrape type 2
2025-11-27 19:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6a0a924-e876-5ad9-84ea-9e09cfa9c039, identifier: 117131446
2025-11-27 19:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-11-27 19:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-11-27 19:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550 to the API
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e16b1caf-3652-5871-a205-1b3f29f09607%27 HTTP/1.1" 200 None
2025-11-27 19:07:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e16b1caf-3652-5871-a205-1b3f29f09607: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117131550?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e16b1caf-3652-5871-a205-1b3f29f09607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BH19XWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131550',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'CITROEN',
 'model': 'GRAND C4 SPACETOURER ESTATE (RC)',
 'odometer': 44461,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': 'Wilsons',
 'title': 'CITROEN GRAND C4 SPACETOURER ESTATE (RC) 1.2 PureTech 130 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-11-27 19:07:24 [astonbarclay.gb] INFO: Saving data for 117131550: {'auction_closing_time': 1764334800.0, 'created_time': 1763060638.767022, 'last_price_update_time': 1764270444.813071}
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131550') HTTP/1.1" 204 0
2025-11-27 19:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2965a328-d788-5390-81b9-bc8fb1007771 with identifier: 117269311
2025-11-27 19:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2965a328-d788-5390-81b9-bc8fb1007771 with identifier: 117269311
2025-11-27 19:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2965a328-d788-5390-81b9-bc8fb1007771 with identifier: 117269311 to the API
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272965a328-d788-5390-81b9-bc8fb1007771%27 HTTP/1.1" 200 None
2025-11-27 19:07:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2965a328-d788-5390-81b9-bc8fb1007771: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117269311?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2965a328-d788-5390-81b9-bc8fb1007771',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MF69JZG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117269311',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'SEAT',
 'model': 'ARONA HATCHBACK',
 'odometer': 53292,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-04',
 'seller_name': 'BS Marson Fiat',
 'title': 'SEAT ARONA HATCHBACK 1.0 TSI 115 FR [EZ] 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 115 FR [EZ] 5dr DSG',
 'vin': None,
 'year': 2019}
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269311%27 HTTP/1.1" 200 None
2025-11-27 19:07:25 [astonbarclay.gb] INFO: Saving data for 117269311: {'auction_closing_time': 1764334800.0, 'created_time': 1763406109.742529, 'last_price_update_time': 1764270445.098383}
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117269311') HTTP/1.1" 204 0
2025-11-27 19:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-11-27 19:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-11-27 19:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153260
2025-11-27 19:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 spider: astonbarclay.gb
2025-11-27 19:07:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 due to rule: high_mileage_for_country.json, error: 153260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153260
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd6a0a924-e876-5ad9-84ea-9e09cfa9c039',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV20KJO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131446',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 95232,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-07',
 'seller_name': 'Wilsons',
 'title': 'TESLA MODEL 3 SALOON Performance AWD 4dr [Performance Upgrade] Auto',
 'transmission': 'automatic',
 'trim': 'Performance AWD 4dr [Performance Upgrade] Auto',
 'vin': None,
 'year': 2020}
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-11-27 19:07:25 [astonbarclay.gb] INFO: Saving data for 117131446: {'auction_closing_time': 1764334800.0, 'created_time': 1763060550.303965, 'last_price_update_time': 1764270445.316453}
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131446') HTTP/1.1" 204 0
2025-11-27 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117243071?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117243027?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117288542?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131404, 'registration': 'GY17CRX', 'account': 'WIL004', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 48702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 16, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c250211a-7e59-46ae-b9f7-9821ba2ce6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c195c5b0-711e-4c98-ac15-d02ba041a89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/b52d7545-f7f4-459d-bfe7-14c96feeed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/5832d238-845c-444c-b980-de05cbd3db2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/a25139dc-6fe3-46ff-a548-b1e3ff85ab8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/8709b038-5e9e-4be7-bc8b-802d263519dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/6192412d-cd19-4519-b2e8-d23881c4b825_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/627df8ca-6eab-4d23-8977-65defd8c6abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/2d518c96-d513-45b4-a0ac-73772c7f8fd0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/19 12K 03/21 27K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8648b8e4-a601-49da-9cf8-c772842242fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131404, 'registration': 'GY17CRX', 'account': 'WIL004', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 48702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 16, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c250211a-7e59-46ae-b9f7-9821ba2ce6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c195c5b0-711e-4c98-ac15-d02ba041a89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/b52d7545-f7f4-459d-bfe7-14c96feeed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/5832d238-845c-444c-b980-de05cbd3db2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/a25139dc-6fe3-46ff-a548-b1e3ff85ab8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/8709b038-5e9e-4be7-bc8b-802d263519dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/6192412d-cd19-4519-b2e8-d23881c4b825_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/627df8ca-6eab-4d23-8977-65defd8c6abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/2d518c96-d513-45b4-a0ac-73772c7f8fd0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/19 12K 03/21 27K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8648b8e4-a601-49da-9cf8-c772842242fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-11-27 19:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cb08f6-7578-50ce-b7bb-eea640cf2775 with scrape type 2
2025-11-27 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8cb08f6-7578-50ce-b7bb-eea640cf2775 with scrape type 2
2025-11-27 19:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8cb08f6-7578-50ce-b7bb-eea640cf2775, identifier: 117131404
2025-11-27 19:07:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117051310, 'registration': 'LB66ZGG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 3dr [AC]', 'mileage': 36775, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 15, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-02-22', 'fuel': 'Petrol', 'motExpiry': '2026-02-21', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/39df14a8-3e2d-498f-a00f-05a539eb850e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/7aed7243-7584-48a8-ab97-2eb7a25e85ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/656760e6-776b-4806-89ce-3cee0405d42f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ff12a178-e830-491a-9746-cd7aa900c4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/58ed45d7-1526-43c8-80f7-26a2156a6271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/feb5e820-8533-417a-a971-cc202187cdbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/bf264d2b-3050-4647-a7d9-7361fe95e655_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ef4048e4-beef-482b-b0e8-33484292591e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/06bf0ca3-110b-4bbd-945e-6d301a514088_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 02/18 5K 01/19 12K 03/20 19K 03/21 24K 03/22 27K INV @ 03/23 29K 02/24 32K 03/25 35K', 'remarks': 'NO SPARE KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00ea978e-c8bf-4ca7-8863-5f5618f574a9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117051310, 'registration': 'LB66ZGG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 3dr [AC]', 'mileage': 36775, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 15, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-02-22', 'fuel': 'Petrol', 'motExpiry': '2026-02-21', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/39df14a8-3e2d-498f-a00f-05a539eb850e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/7aed7243-7584-48a8-ab97-2eb7a25e85ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/656760e6-776b-4806-89ce-3cee0405d42f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ff12a178-e830-491a-9746-cd7aa900c4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/58ed45d7-1526-43c8-80f7-26a2156a6271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/feb5e820-8533-417a-a971-cc202187cdbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/bf264d2b-3050-4647-a7d9-7361fe95e655_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ef4048e4-beef-482b-b0e8-33484292591e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/06bf0ca3-110b-4bbd-945e-6d301a514088_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 02/18 5K 01/19 12K 03/20 19K 03/21 24K 03/22 27K INV @ 03/23 29K 02/24 32K 03/25 35K', 'remarks': 'NO SPARE KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00ea978e-c8bf-4ca7-8863-5f5618f574a9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310
2025-11-27 19:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d4d498d-9c16-52cc-8328-f18328382bce with scrape type 2
2025-11-27 19:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d4d498d-9c16-52cc-8328-f18328382bce with scrape type 2
2025-11-27 19:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5d4d498d-9c16-52cc-8328-f18328382bce, identifier: 117051310
2025-11-27 19:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-11-27 19:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-11-27 19:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404 to the API
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d8cb08f6-7578-50ce-b7bb-eea640cf2775%27 HTTP/1.1" 200 None
2025-11-27 19:07:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d8cb08f6-7578-50ce-b7bb-eea640cf2775: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:25 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117131404?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd8cb08f6-7578-50ce-b7bb-eea640cf2775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY17CRX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131404',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 48702,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': 'Wilsons',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE Tech 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 SE Tech 5dr Auto',
 'vin': None,
 'year': 2017}
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-11-27 19:07:25 [astonbarclay.gb] INFO: Saving data for 117131404: {'auction_closing_time': 1764334800.0, 'created_time': 1763060555.156275, 'last_price_update_time': 1764270445.801847}
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131404') HTTP/1.1" 204 0
2025-11-27 19:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310
2025-11-27 19:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310
2025-11-27 19:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310 to the API
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275d4d498d-9c16-52cc-8328-f18328382bce%27 HTTP/1.1" 200 None
2025-11-27 19:07:26 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5d4d498d-9c16-52cc-8328-f18328382bce: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:25 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117051310?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5d4d498d-9c16-52cc-8328-f18328382bce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB66ZGG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117051310',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK SPECIAL EDS',
 'odometer': 36775,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': 'Wilsons',
 'title': 'VAUXHALL CORSA HATCHBACK SPECIAL EDS 1.4 [75] ecoFLEX Energy 3dr '
          '[AC]',
 'transmission': 'manual',
 'trim': '1.4 [75] ecoFLEX Energy 3dr [AC]',
 'vin': None,
 'year': 2017}
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117051310%27 HTTP/1.1" 200 None
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Saving data for 117051310: {'auction_closing_time': 1764334800.0, 'created_time': 1762938049.172648, 'last_price_update_time': 1764270446.0757}
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117051310') HTTP/1.1" 204 0
2025-11-27 19:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024415?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117031158?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117243071, 'registration': 'PN19TFE', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 N-Connecta 5dr', 'mileage': 46730, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 14, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN19TFE/2025-11-19/image/ff6a533c-7a71-41fc-a82a-f02229dfaddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/e8775db4-a7c5-4e66-b9cb-7ea943022429_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/f0273086-c915-41cc-af57-e26f783878af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/15202e68-a80b-4e6a-aa45-ae09e1a304ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/18f7690b-0781-475b-86c7-58076effbe93_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/d51971c3-8376-4813-9f0f-2782a1f4ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/be766b33-81f0-4df4-9188-ae11aac650fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/bd8568bc-35b1-4154-9820-da18eb307293_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/a34457d6-9af4-41e4-9726-0f756279b9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 10/22 25K 08/23 30K 08/24 38K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13710208-7bbc-4fca-8548-3fa49b124abd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117243071, 'registration': 'PN19TFE', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 N-Connecta 5dr', 'mileage': 46730, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 14, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN19TFE/2025-11-19/image/ff6a533c-7a71-41fc-a82a-f02229dfaddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/e8775db4-a7c5-4e66-b9cb-7ea943022429_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/f0273086-c915-41cc-af57-e26f783878af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/15202e68-a80b-4e6a-aa45-ae09e1a304ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/18f7690b-0781-475b-86c7-58076effbe93_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/d51971c3-8376-4813-9f0f-2782a1f4ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/be766b33-81f0-4df4-9188-ae11aac650fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/bd8568bc-35b1-4154-9820-da18eb307293_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/a34457d6-9af4-41e4-9726-0f756279b9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 10/22 25K 08/23 30K 08/24 38K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13710208-7bbc-4fca-8548-3fa49b124abd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-11-27 19:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with scrape type 2
2025-11-27 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with scrape type 2
2025-11-27 19:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5, identifier: 117243071
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117243027, 'registration': 'HS16KYR', 'account': 'WIL004', 'make': 'RENAULT', 'model': 'CAPTUR DIESEL HATCHBACK', 'derivative': '1.5 dCi 90 Signature Nav 5dr Auto', 'mileage': 61234, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 13, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-07-28', 'fuel': 'Diesel', 'motExpiry': '2026-07-28', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16KYR/2025-11-20/image/f15eb871-0801-4f66-b181-9b260e51db93_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/01887831-45c6-4178-9164-8efb783fab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/2c17fcf4-ace5-4e73-8b23-af70f6006b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/1ad74979-4ca0-425b-b24f-f05fc95ae52a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/af417018-fb12-48eb-89ea-ece2e5a0256b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/bfacb41e-26fd-4bff-987a-dbeaa34fb947_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/84f5d3e7-a6a0-448f-b4d8-6bab035f585c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/47bc54f0-8c82-487a-b602-d4c50d4356ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/0a404ab4-3aed-40db-9fc1-8fb0bc8ae68b_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/17 10K 07/17 15K (SB ERROR) 07/19 20K 07/20 26K 07/21 33K 07/22 41K 07/23 47K 07/24 53K 06/25 59K', 'remarks': 'SD CARD / NO SPARE KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/214a2f49-f4a1-4549-b578-b086b6a9a118.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117243027, 'registration': 'HS16KYR', 'account': 'WIL004', 'make': 'RENAULT', 'model': 'CAPTUR DIESEL HATCHBACK', 'derivative': '1.5 dCi 90 Signature Nav 5dr Auto', 'mileage': 61234, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 13, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-07-28', 'fuel': 'Diesel', 'motExpiry': '2026-07-28', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16KYR/2025-11-20/image/f15eb871-0801-4f66-b181-9b260e51db93_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/01887831-45c6-4178-9164-8efb783fab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/2c17fcf4-ace5-4e73-8b23-af70f6006b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/1ad74979-4ca0-425b-b24f-f05fc95ae52a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/af417018-fb12-48eb-89ea-ece2e5a0256b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/bfacb41e-26fd-4bff-987a-dbeaa34fb947_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/84f5d3e7-a6a0-448f-b4d8-6bab035f585c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/47bc54f0-8c82-487a-b602-d4c50d4356ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/0a404ab4-3aed-40db-9fc1-8fb0bc8ae68b_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/17 10K 07/17 15K (SB ERROR) 07/19 20K 07/20 26K 07/21 33K 07/22 41K 07/23 47K 07/24 53K 06/25 59K', 'remarks': 'SD CARD / NO SPARE KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/214a2f49-f4a1-4549-b578-b086b6a9a118.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027
2025-11-27 19:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590613a5-74b5-5f62-bf45-ebc1e4651545 with scrape type 2
2025-11-27 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 590613a5-74b5-5f62-bf45-ebc1e4651545 with scrape type 2
2025-11-27 19:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 590613a5-74b5-5f62-bf45-ebc1e4651545, identifier: 117243027
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117288542, 'registration': 'KR69FEF', 'account': 'KCS002', 'make': 'DS', 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)', 'derivative': '1.5 BlueHDi Prestige 5dr', 'mileage': 59307, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 5, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR69FEF/2025-11-18/image/5fc3ff04-f398-4285-b5fb-bb5c2828a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/82526bb9-5bd4-4632-984f-5c401d7d0c88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/00fe4a7f-54dc-4dda-a46e-8b7dc271ce0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/64807544-65c0-4bc0-ae42-79ef9ab4cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c3bab845-d629-41a8-87a5-71e5c3165e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c9238d51-bd82-4b49-98f7-545d4cd1ce9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/38495995-9694-49c1-b88e-75d619664455_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c2eae0d7-6b92-4b00-b9c3-22a4af31d163_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/0b5ce54f-8971-415d-90c9-b914ea23dd0f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/21 8K 12/24 50K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705f02f4-e35e-4a5e-ba1b-49c0b0a6b704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117288542, 'registration': 'KR69FEF', 'account': 'KCS002', 'make': 'DS', 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)', 'derivative': '1.5 BlueHDi Prestige 5dr', 'mileage': 59307, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 5, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR69FEF/2025-11-18/image/5fc3ff04-f398-4285-b5fb-bb5c2828a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/82526bb9-5bd4-4632-984f-5c401d7d0c88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/00fe4a7f-54dc-4dda-a46e-8b7dc271ce0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/64807544-65c0-4bc0-ae42-79ef9ab4cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c3bab845-d629-41a8-87a5-71e5c3165e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c9238d51-bd82-4b49-98f7-545d4cd1ce9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/38495995-9694-49c1-b88e-75d619664455_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c2eae0d7-6b92-4b00-b9c3-22a4af31d163_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/0b5ce54f-8971-415d-90c9-b914ea23dd0f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/21 8K 12/24 50K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705f02f4-e35e-4a5e-ba1b-49c0b0a6b704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-11-27 19:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306f4428-c66b-5c17-b51a-aa7299ec0e4f with scrape type 2
2025-11-27 19:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 306f4428-c66b-5c17-b51a-aa7299ec0e4f with scrape type 2
2025-11-27 19:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 306f4428-c66b-5c17-b51a-aa7299ec0e4f, identifier: 117288542
2025-11-27 19:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-11-27 19:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-11-27 19:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071 to the API
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5%27 HTTP/1.1" 200 None
2025-11-27 19:07:26 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117243071?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PN19TFE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117243071',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 46730,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seller_name': 'Wilsons',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T 160 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T 160 N-Connecta 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-11-27 19:07:26 [astonbarclay.gb] INFO: Saving data for 117243071: {'auction_closing_time': 1764334800.0, 'created_time': 1763492786.433532, 'last_price_update_time': 1764270446.716472}
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117243071') HTTP/1.1" 204 0
2025-11-27 19:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027
2025-11-27 19:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027
2025-11-27 19:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027 to the API
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27590613a5-74b5-5f62-bf45-ebc1e4651545%27 HTTP/1.1" 200 None
2025-11-27 19:07:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 590613a5-74b5-5f62-bf45-ebc1e4651545: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117243027?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '590613a5-74b5-5f62-bf45-ebc1e4651545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HS16KYR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117243027',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'RENAULT',
 'model': 'CAPTUR DIESEL HATCHBACK',
 'odometer': 61234,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': 'Wilsons',
 'title': 'RENAULT CAPTUR DIESEL HATCHBACK 1.5 dCi 90 Signature Nav 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 dCi 90 Signature Nav 5dr Auto',
 'vin': None,
 'year': 2016}
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243027%27 HTTP/1.1" 200 None
2025-11-27 19:07:27 [astonbarclay.gb] INFO: Saving data for 117243027: {'auction_closing_time': 1764334800.0, 'created_time': 1763492797.01041, 'last_price_update_time': 1764270447.026259}
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117243027') HTTP/1.1" 204 0
2025-11-27 19:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-11-27 19:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-11-27 19:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542 to the API
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27306f4428-c66b-5c17-b51a-aa7299ec0e4f%27 HTTP/1.1" 200 None
2025-11-27 19:07:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 306f4428-c66b-5c17-b51a-aa7299ec0e4f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117288542?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '306f4428-c66b-5c17-b51a-aa7299ec0e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KR69FEF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117288542',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'DS',
 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)',
 'odometer': 59307,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'DS DS 3 DIESEL CROSSBACK HATCHBACK (RC) 1.5 BlueHDi Prestige 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Prestige 5dr',
 'vin': None,
 'year': 2019}
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-11-27 19:07:27 [astonbarclay.gb] INFO: Saving data for 117288542: {'auction_closing_time': 1764334800.0, 'created_time': 1763456461.330598, 'last_price_update_time': 1764270447.53332}
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117288542') HTTP/1.1" 204 0
2025-11-27 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024058?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-11-27 19:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024353?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024415, 'registration': 'WD67EHW', 'account': 'KCS002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Zetec 5dr', 'mileage': 57860, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 3, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD67EHW/2025-11-07/image/4e6c47c1-3f2f-4488-afa1-fc8e12b014af_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/8136f56e-5784-460b-9336-a77ecefc8a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/3531f1d9-e65a-44ad-b833-0651b70f95c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c803b8ca-86c6-4222-8785-1e0e90067805_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c7ab2881-af9a-4a6a-ab74-0efaaf1ed393_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/07793055-c8de-4b5a-8568-5adc4491e6d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/db07c549-b6c9-460b-acab-7a74c34b2df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/5a6fc851-6c3a-487b-9a87-b99f3c6474ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/da9892df-7993-4621-886d-ebd0e08c1eaa_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/19 10K 01/20 17K 01/22 41K 10/22 43K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b8e862c-7c0c-4c96-aafc-ffba019b743b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024415, 'registration': 'WD67EHW', 'account': 'KCS002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Zetec 5dr', 'mileage': 57860, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 3, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD67EHW/2025-11-07/image/4e6c47c1-3f2f-4488-afa1-fc8e12b014af_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/8136f56e-5784-460b-9336-a77ecefc8a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/3531f1d9-e65a-44ad-b833-0651b70f95c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c803b8ca-86c6-4222-8785-1e0e90067805_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c7ab2881-af9a-4a6a-ab74-0efaaf1ed393_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/07793055-c8de-4b5a-8568-5adc4491e6d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/db07c549-b6c9-460b-acab-7a74c34b2df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/5a6fc851-6c3a-487b-9a87-b99f3c6474ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/da9892df-7993-4621-886d-ebd0e08c1eaa_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/19 10K 01/20 17K 01/22 41K 10/22 43K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b8e862c-7c0c-4c96-aafc-ffba019b743b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415
2025-11-27 19:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547d852c-3964-53d0-a29b-7e0b93ff6074 with scrape type 2
2025-11-27 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 547d852c-3964-53d0-a29b-7e0b93ff6074 with scrape type 2
2025-11-27 19:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 547d852c-3964-53d0-a29b-7e0b93ff6074, identifier: 117024415
2025-11-27 19:07:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117031158, 'registration': 'YS65OEF', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.2 DiG-T Acenta Premium 5dr', 'mileage': 59545, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 4, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-02-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65OEF/2025-11-10/image/81cc8444-232c-4597-83c8-dc957c7e03dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/870dd011-5f48-4ae5-9fae-2fdfffa6f5ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/87380db9-76cd-4b7d-8454-e672c14416e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/b5d056cf-bcab-4097-8487-2808f295ff5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/4c1959ee-6cc9-4f8c-a9aa-970edd8e87f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/2a8c7184-61cf-480e-b850-061ca15b3871_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/7a35beb0-040d-4daf-b65a-51381250c07b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/ebd71b64-7305-4d23-9096-1fbe5ee84cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/6935df5a-541f-48ea-bd9c-1102cef9f263_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/c8b1c786-a003-405b-a0cb-7d51a7ed8356_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 10K 01/18 19K 05/19 30K 07/20 34K 07/21 36K 07/22 38K 07/23 40K 01/24 48K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecb7fe82-dff9-4750-a23b-a81c9f96593b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117031158, 'registration': 'YS65OEF', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.2 DiG-T Acenta Premium 5dr', 'mileage': 59545, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 4, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-02-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65OEF/2025-11-10/image/81cc8444-232c-4597-83c8-dc957c7e03dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/870dd011-5f48-4ae5-9fae-2fdfffa6f5ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/87380db9-76cd-4b7d-8454-e672c14416e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/b5d056cf-bcab-4097-8487-2808f295ff5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/4c1959ee-6cc9-4f8c-a9aa-970edd8e87f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/2a8c7184-61cf-480e-b850-061ca15b3871_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/7a35beb0-040d-4daf-b65a-51381250c07b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/ebd71b64-7305-4d23-9096-1fbe5ee84cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/6935df5a-541f-48ea-bd9c-1102cef9f263_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/c8b1c786-a003-405b-a0cb-7d51a7ed8356_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 10K 01/18 19K 05/19 30K 07/20 34K 07/21 36K 07/22 38K 07/23 40K 01/24 48K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecb7fe82-dff9-4750-a23b-a81c9f96593b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158
2025-11-27 19:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f804a5-8200-582a-bad4-53947e767941 with scrape type 2
2025-11-27 19:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90f804a5-8200-582a-bad4-53947e767941 with scrape type 2
2025-11-27 19:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 90f804a5-8200-582a-bad4-53947e767941, identifier: 117031158
2025-11-27 19:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415
2025-11-27 19:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415
2025-11-27 19:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415 to the API
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27547d852c-3964-53d0-a29b-7e0b93ff6074%27 HTTP/1.1" 200 None
2025-11-27 19:07:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 547d852c-3964-53d0-a29b-7e0b93ff6074: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:27 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024415?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '547d852c-3964-53d0-a29b-7e0b93ff6074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WD67EHW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024415',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'ECOSPORT HATCHBACK',
 'odometer': 57860,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost 125 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Zetec 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024415%27 HTTP/1.1" 200 None
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Saving data for 117024415: {'auction_closing_time': 1764334800.0, 'created_time': 1762455713.642953, 'last_price_update_time': 1764270448.039621}
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024415') HTTP/1.1" 204 0
2025-11-27 19:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158
2025-11-27 19:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158
2025-11-27 19:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158 to the API
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2790f804a5-8200-582a-bad4-53947e767941%27 HTTP/1.1" 200 None
2025-11-27 19:07:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 90f804a5-8200-582a-bad4-53947e767941: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:27 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117031158?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '90f804a5-8200-582a-bad4-53947e767941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS65OEF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117031158',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 59545,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN JUKE HATCHBACK 1.2 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Acenta Premium 5dr',
 'vin': None,
 'year': 2016}
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117031158%27 HTTP/1.1" 200 None
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Saving data for 117031158: {'auction_closing_time': 1764334800.0, 'created_time': 1762506126.703862, 'last_price_update_time': 1764270448.323594}
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117031158') HTTP/1.1" 204 0
2025-11-27 19:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024058, 'registration': 'MR51ZUK', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SE 5dr', 'mileage': 66518, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 1, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/0fbc2b6f-d2e4-4b71-9af0-a95b82da3901_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b59f2b05-b1f0-4bac-8c0e-79908fd0e8a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/3d524d08-0902-4518-964e-0ffe909069f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b62b162d-1959-4d54-a32e-1a4c25d7ad06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/87467e67-a3d5-4dd0-a818-0dfed2579e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/526ae119-922c-45a2-a923-ff39b2a1e23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/96a5fc3c-84e0-45d5-b7f1-1130235f8667_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/069f69a2-c22d-499d-9dd5-e33f5b5cb56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/501e76e6-43fe-4f39-8438-9d707d92d7a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/a5a01529-354b-4299-ba28-a47203256140_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - *Plate May Not Remain with Vehicle*', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e2cb7ebd-2729-41c9-8b34-ee3baed84e60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024058, 'registration': 'MR51ZUK', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SE 5dr', 'mileage': 66518, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 1, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/0fbc2b6f-d2e4-4b71-9af0-a95b82da3901_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b59f2b05-b1f0-4bac-8c0e-79908fd0e8a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/3d524d08-0902-4518-964e-0ffe909069f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b62b162d-1959-4d54-a32e-1a4c25d7ad06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/87467e67-a3d5-4dd0-a818-0dfed2579e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/526ae119-922c-45a2-a923-ff39b2a1e23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/96a5fc3c-84e0-45d5-b7f1-1130235f8667_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/069f69a2-c22d-499d-9dd5-e33f5b5cb56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/501e76e6-43fe-4f39-8438-9d707d92d7a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/a5a01529-354b-4299-ba28-a47203256140_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - *Plate May Not Remain with Vehicle*', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e2cb7ebd-2729-41c9-8b34-ee3baed84e60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-11-27 19:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with scrape type 2
2025-11-27 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with scrape type 2
2025-11-27 19:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9655b4b9-2675-58ef-a11e-03b69ddaeff4, identifier: 117024058
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117366081, 'registration': 'SD72TFA', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'RWD 5dr Auto', 'mileage': 31868, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 147, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SD72TFA/2025-11-26/image/a94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/aa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/b987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/f394dffd-8bc4-4307-9786-13c332760711_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/dc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 31K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/71ad1ec3-966b-4fe8-a959-bda76134d96e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117366081, 'registration': 'SD72TFA', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL Y HATCHBACK', 'derivative': 'RWD 5dr Auto', 'mileage': 31868, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 147, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-25', 'fuel': 'Electric', 'motExpiry': '2026-11-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SD72TFA/2025-11-26/image/a94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/aa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/b987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/f394dffd-8bc4-4307-9786-13c332760711_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/dc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 31K CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/71ad1ec3-966b-4fe8-a959-bda76134d96e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d with identifier: 117366081
2025-11-27 19:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d with scrape type 1
2025-11-27 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Fa94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/a94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024353, 'registration': 'KJ18UDH', 'account': 'KCS002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 5dr', 'mileage': 55760, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 2, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/f766b7b4-f6b3-427b-91f2-db043f15342e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2d7f92d9-aa3e-4440-aae7-b066cf5594a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/86e2a420-d758-4d1f-a2f4-2860b86cc1d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/82ac0aed-a8db-4fa9-a6fe-76030140c08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b7d3b398-75f4-4fdf-8770-48be014880c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/420351c1-9807-44dd-8306-c89f7a672acc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2f9b0f0e-dd90-452e-a73b-80d042ddd820_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b6948e82-efa9-423d-a88c-ab71d127f9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/c61f4a2e-0fff-4ab5-9b6c-aa7e81a1b58b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 04/21 15K', 'remarks': 'NO SPARE KEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d845f5a5-bdbe-4ad5-9c24-1342ba997053.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024353, 'registration': 'KJ18UDH', 'account': 'KCS002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 5dr', 'mileage': 55760, 'mileageWarranty': True, 'type': 'car', 'saleId': 17959, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 94}, 'saleStart': '2025-11-28T13:00Z', 'lot': 2, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/f766b7b4-f6b3-427b-91f2-db043f15342e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2d7f92d9-aa3e-4440-aae7-b066cf5594a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/86e2a420-d758-4d1f-a2f4-2860b86cc1d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/82ac0aed-a8db-4fa9-a6fe-76030140c08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b7d3b398-75f4-4fdf-8770-48be014880c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/420351c1-9807-44dd-8306-c89f7a672acc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2f9b0f0e-dd90-452e-a73b-80d042ddd820_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b6948e82-efa9-423d-a88c-ab71d127f9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/c61f4a2e-0fff-4ab5-9b6c-aa7e81a1b58b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 04/21 15K', 'remarks': 'NO SPARE KEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d845f5a5-bdbe-4ad5-9c24-1342ba997053.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-11-27 19:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-11-27 19:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with scrape type 2
2025-11-27 19:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with scrape type 2
2025-11-27 19:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9502caad-ffbb-55ee-8b5d-4a3906815fe5, identifier: 117024353
2025-11-27 19:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-11-27 19:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-11-27 19:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058 to the API
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279655b4b9-2675-58ef-a11e-03b69ddaeff4%27 HTTP/1.1" 200 None
2025-11-27 19:07:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9655b4b9-2675-58ef-a11e-03b69ddaeff4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024058?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9655b4b9-2675-58ef-a11e-03b69ddaeff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MR51ZUK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024058',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 66518,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo SE 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-11-27 19:07:28 [astonbarclay.gb] INFO: Saving data for 117024058: {'auction_closing_time': 1764334800.0, 'created_time': 1762455702.144844, 'last_price_update_time': 1764270448.861811}
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024058') HTTP/1.1" 204 0
2025-11-27 19:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-11-27 19:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-11-27 19:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353 to the API
2025-11-27 19:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279502caad-ffbb-55ee-8b5d-4a3906815fe5%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9502caad-ffbb-55ee-8b5d-4a3906815fe5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 27 Nov 2025 19:07:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-11-27 19:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024353?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-11-28T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9502caad-ffbb-55ee-8b5d-4a3906815fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KJ18UDH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024353',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 55760,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'MINI HATCHBACK 1.5 Cooper II 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper II 5dr',
 'vin': None,
 'year': 2018}
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Saving data for 117024353: {'auction_closing_time': 1764334800.0, 'created_time': 1762455731.028291, 'last_price_update_time': 1764270449.155099}
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024353') HTTP/1.1" 204 0
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117320089?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116921234?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Faa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/aa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116824054, 'registration': 'NU72BDX', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG5 ELECTRIC ESTATE', 'derivative': '115kW Excite EV 61kWh 5dr Auto', 'mileage': 10779, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 140, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-10', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**868**VOSA STATES 4K SPARE KEY Metallic Paint CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/654237f0-3b86-4940-bafe-819605b16126.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116824054, 'registration': 'NU72BDX', 'account': 'ZEN002', 'make': 'MG MOTOR UK', 'model': 'MG5 ELECTRIC ESTATE', 'derivative': '115kW Excite EV 61kWh 5dr Auto', 'mileage': 10779, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 140, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-10', 'fuel': 'Electric', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**868**VOSA STATES 4K SPARE KEY Metallic Paint CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/654237f0-3b86-4940-bafe-819605b16126.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb474c2f-8360-5cd9-9c59-afa5c40d0222 with identifier: 116824054
2025-11-27 19:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb474c2f-8360-5cd9-9c59-afa5c40d0222 with scrape type 1
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117490150, 'registration': 'YE71CXZ', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S]', 'mileage': 60122, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 146, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-26', 'fuel': 'Electric', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 18K, 01/24 - 37K', 'remarks': '**994**VOSA STATES 47K, 59K, SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fcd36077-5554-4294-8654-ea68be86f820.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117490150, 'registration': 'YE71CXZ', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'Q4 E-TRON ESTATE', 'derivative': '150kW 40 82kWh S Line 5dr Auto [C+S]', 'mileage': 60122, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 146, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-26', 'fuel': 'Electric', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22 - 18K, 01/24 - 37K', 'remarks': '**994**VOSA STATES 47K, 59K, SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fcd36077-5554-4294-8654-ea68be86f820.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5695cd03-d320-5f17-8c6c-374dd45f343e with identifier: 117490150
2025-11-27 19:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5695cd03-d320-5f17-8c6c-374dd45f343e with scrape type 1
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Fb987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/b987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/a94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117405738, 'registration': 'GV23FSZ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 250+ 140kW AMG Line 70.5kWh 5dr Auto', 'mileage': 4559, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 139, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-06-05', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/24 - 2K, 07/25 - 4K', 'remarks': '**939** SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d6035eb-9dd6-4fc6-8a20-609a2ac24fdd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117405738, 'registration': 'GV23FSZ', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'EQA HATCHBACK', 'derivative': 'EQA 250+ 140kW AMG Line 70.5kWh 5dr Auto', 'mileage': 4559, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 139, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-06-05', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600', 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/24 - 2K, 07/25 - 4K', 'remarks': '**939** SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d6035eb-9dd6-4fc6-8a20-609a2ac24fdd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 919c451d-adc1-50d1-9d85-410cab300e8c with identifier: 117405738
2025-11-27 19:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 919c451d-adc1-50d1-9d85-410cab300e8c with scrape type 1
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252Fee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117320089, 'registration': 'FH22NXD', 'account': 'ZEN002', 'make': 'BMW', 'model': '5 SERIES SALOON', 'derivative': '530e xDrive SE 4dr Auto', 'mileage': 51117, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 109, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-24', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/FH22NXD/2025-11-27/image/72ad23a3-f261-4ca3-91fb-f213c21f2735_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/f09d70fb-59a8-4f6c-934e-885bb1cff70b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/7350b951-4d36-45ef-93bc-e6c7decf7260_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/a86ed941-f5d0-496f-b0a4-dfbf00d1f9f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/544e9549-a81f-496a-af2b-76007473a7ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/952034bd-16d6-4eae-b4fc-39a4958a975c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/d6b7f4b0-2362-4a4c-a63e-67732a22db63_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/710ed3e1-34e9-45c8-913b-cafcdfb817fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/18611ab4-3e32-4fc7-8265-5373afe763a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/56ca6116-a1f5-43be-a8e0-a946b4d56f29_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/23 - 21K, 06/25- 37K', 'remarks': '**1000**VOSA STATES 37K 19in Light Alloy V-spoke Style 635\tAdaptive Led Headlights\tComfort Plus Pack Exclusive Nappa Lthr M+465+zgm/Zgx\tPhytonic Blue\tTechnology Plus Pack Through Loading Sys-40/20/40 Split, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/42e64cda-faf5-48c5-93f9-c660c5fb3c81.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117320089, 'registration': 'FH22NXD', 'account': 'ZEN002', 'make': 'BMW', 'model': '5 SERIES SALOON', 'derivative': '530e xDrive SE 4dr Auto', 'mileage': 51117, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 109, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-06-24', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/FH22NXD/2025-11-27/image/72ad23a3-f261-4ca3-91fb-f213c21f2735_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/f09d70fb-59a8-4f6c-934e-885bb1cff70b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/7350b951-4d36-45ef-93bc-e6c7decf7260_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/a86ed941-f5d0-496f-b0a4-dfbf00d1f9f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/544e9549-a81f-496a-af2b-76007473a7ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/952034bd-16d6-4eae-b4fc-39a4958a975c_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/d6b7f4b0-2362-4a4c-a63e-67732a22db63_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/710ed3e1-34e9-45c8-913b-cafcdfb817fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/18611ab4-3e32-4fc7-8265-5373afe763a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/FH22NXD/2025-11-27/image/56ca6116-a1f5-43be-a8e0-a946b4d56f29_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/23 - 21K, 06/25- 37K', 'remarks': '**1000**VOSA STATES 37K 19in Light Alloy V-spoke Style 635\tAdaptive Led Headlights\tComfort Plus Pack Exclusive Nappa Lthr M+465+zgm/Zgx\tPhytonic Blue\tTechnology Plus Pack Through Loading Sys-40/20/40 Split, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/42e64cda-faf5-48c5-93f9-c660c5fb3c81.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad3bd243-2333-59e4-a546-d5961c53275f with identifier: 117320089
2025-11-27 19:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad3bd243-2333-59e4-a546-d5961c53275f with scrape type 2
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad3bd243-2333-59e4-a546-d5961c53275f with scrape type 2
2025-11-27 19:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ad3bd243-2333-59e4-a546-d5961c53275f, identifier: 117320089
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116921234, 'registration': 'VN71BUP', 'account': 'ZEN002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR ESTATE', 'derivative': '2.0 P400e R-Dynamic SE 5dr Auto', 'mileage': 66961, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 63, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-19', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-02', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71BUP/2025-11-14/image/5d9731bf-c36a-4ce3-a12c-293a49c497a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/41124a8b-2081-4e90-bb22-07cd48098d26_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/d034f199-3287-4fe7-aea0-27e75c4843c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/526cf9a7-0e65-4782-b3ee-32797e45eaa5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/70e85a15-2eeb-40c4-ad9c-cd2b4c6bff4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/57049930-b573-4216-a60d-08eb006b031d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/fdc8d73f-788e-4e45-a89b-54c9b78807b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/572136c1-77f1-4b80-ab08-fe6df634a4ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/b3505e9b-836a-40cb-a8d4-9b938d24559f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23- 20K, 06/24-40K,', 'remarks': '**720**VOSA STATES 46K, 62K  SPARE KEY   21in Style 5109 Stnm =027cw\tBP collect & inspect\tHome Charging Cable Light Oyster Morzine Headlining\tNo Roof Rails\tPark Assist Premium Cabin Lighting\tPrivacy Glass\tR-dynamic Black Pack Santorini Black - Metallic Paint\tSliding Panoramic Roof  CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 57, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fdf381d1-ab84-4502-aa16-0c20d74cb060.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116921234, 'registration': 'VN71BUP', 'account': 'ZEN002', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR ESTATE', 'derivative': '2.0 P400e R-Dynamic SE 5dr Auto', 'mileage': 66961, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 63, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-19', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-02', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VN71BUP/2025-11-14/image/5d9731bf-c36a-4ce3-a12c-293a49c497a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/41124a8b-2081-4e90-bb22-07cd48098d26_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/d034f199-3287-4fe7-aea0-27e75c4843c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/526cf9a7-0e65-4782-b3ee-32797e45eaa5_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/70e85a15-2eeb-40c4-ad9c-cd2b4c6bff4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/57049930-b573-4216-a60d-08eb006b031d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/fdc8d73f-788e-4e45-a89b-54c9b78807b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/572136c1-77f1-4b80-ab08-fe6df634a4ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/VN71BUP/2025-11-14/image/b3505e9b-836a-40cb-a8d4-9b938d24559f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23- 20K, 06/24-40K,', 'remarks': '**720**VOSA STATES 46K, 62K  SPARE KEY   21in Style 5109 Stnm =027cw\tBP collect & inspect\tHome Charging Cable Light Oyster Morzine Headlining\tNo Roof Rails\tPark Assist Premium Cabin Lighting\tPrivacy Glass\tR-dynamic Black Pack Santorini Black - Metallic Paint\tSliding Panoramic Roof  CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 57, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fdf381d1-ab84-4502-aa16-0c20d74cb060.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8128f73d-631d-5c01-9958-de0debc1d1d8 with identifier: 116921234
2025-11-27 19:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8128f73d-631d-5c01-9958-de0debc1d1d8 with scrape type 2
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8128f73d-631d-5c01-9958-de0debc1d1d8 with scrape type 2
2025-11-27 19:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8128f73d-631d-5c01-9958-de0debc1d1d8, identifier: 116921234
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/b987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/aa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252Fb5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252Fd0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ad3bd243-2333-59e4-a546-d5961c53275f with identifier: 117320089
2025-11-27 19:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ad3bd243-2333-59e4-a546-d5961c53275f with identifier: 117320089
2025-11-27 19:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ad3bd243-2333-59e4-a546-d5961c53275f with identifier: 117320089 to the API
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117320089?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'ad3bd243-2333-59e4-a546-d5961c53275f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FH22NXD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117320089',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '5 SERIES SALOON',
 'odometer': 51117,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seller_name': 'Zenith',
 'title': 'BMW 5 SERIES SALOON 530e xDrive SE 4dr Auto',
 'transmission': 'automatic',
 'trim': '530e xDrive SE 4dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117320089%27 HTTP/1.1" 200 None
2025-11-27 19:07:29 [astonbarclay.gb] INFO: Saving data for 117320089: {'auction_closing_time': 1764323100.0, 'created_time': 1764147726.98261, 'last_price_update_time': 1764270449.993633}
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117320089') HTTP/1.1" 204 0
2025-11-27 19:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8128f73d-631d-5c01-9958-de0debc1d1d8 with identifier: 116921234
2025-11-27 19:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8128f73d-631d-5c01-9958-de0debc1d1d8 with identifier: 116921234
2025-11-27 19:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8128f73d-631d-5c01-9958-de0debc1d1d8 with identifier: 116921234 to the API
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116921234?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 57,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '8128f73d-631d-5c01-9958-de0debc1d1d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VN71BUP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116921234',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR ESTATE',
 'odometer': 66961,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seller_name': 'Zenith',
 'title': 'LAND ROVER RANGE ROVER VELAR ESTATE 2.0 P400e R-Dynamic SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 P400e R-Dynamic SE 5dr Auto',
 'vin': None,
 'year': 2021}
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116921234%27 HTTP/1.1" 200 None
2025-11-27 19:07:30 [astonbarclay.gb] INFO: Saving data for 116921234: {'auction_closing_time': 1764323100.0, 'created_time': 1763492922.531102, 'last_price_update_time': 1764270450.277719}
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116921234') HTTP/1.1" 204 0
2025-11-27 19:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Ff394dffd-8bc4-4307-9786-13c332760711_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/f394dffd-8bc4-4307-9786-13c332760711_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252Fdf9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9faea5d0>
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Fa94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/a94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe13d10>
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117042418?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e909350>
2025-11-27 19:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Fb987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/b987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d06e350>
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Faa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/aa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0d710>
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252Fddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb77250>
2025-11-27 19:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe1dc90>
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd01510>
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fed18d0>
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117042418, 'registration': 'MJ72HTY', 'account': 'ZEN009', 'make': 'CITROEN', 'model': 'C4 HATCHBACK', 'derivative': '1.2 PureTech [130] C-Series Edition 5dr', 'mileage': 18509, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 61, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/b37ca70b-701f-4b98-af98-1a6e356c5ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/44d85b87-90b1-4043-aaa7-fb8cb7ef1368_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/fb12fd3b-12a5-4a91-a5ba-5fe34d72abcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/f4b604be-c0d8-4fe3-879c-c21230bfa549_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/14324f81-2814-4515-bae3-dcf3bbc94824_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/d708994f-0acd-40dd-9bca-7b0042c31934_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/16d446e8-0d78-4af4-a47a-f12b4cd10f58_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/4324d6e2-1d48-4261-b80e-3b8dd50b74e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/42934cee-d97a-4550-9139-106eaaa39ffe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/24- 6K', 'remarks': '**996**VOSA STATES 17K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5d774304-e6d3-476f-9b7c-62f0023aecc7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117042418, 'registration': 'MJ72HTY', 'account': 'ZEN009', 'make': 'CITROEN', 'model': 'C4 HATCHBACK', 'derivative': '1.2 PureTech [130] C-Series Edition 5dr', 'mileage': 18509, 'mileageWarranty': True, 'type': 'car', 'saleId': 17590, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 347}, 'saleStart': '2025-11-28T09:45Z', 'lot': 61, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/b37ca70b-701f-4b98-af98-1a6e356c5ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/44d85b87-90b1-4043-aaa7-fb8cb7ef1368_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/fb12fd3b-12a5-4a91-a5ba-5fe34d72abcc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/f4b604be-c0d8-4fe3-879c-c21230bfa549_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/14324f81-2814-4515-bae3-dcf3bbc94824_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/d708994f-0acd-40dd-9bca-7b0042c31934_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/16d446e8-0d78-4af4-a47a-f12b4cd10f58_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/4324d6e2-1d48-4261-b80e-3b8dd50b74e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ72HTY/2025-11-27/image/42934cee-d97a-4550-9139-106eaaa39ffe_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/24- 6K', 'remarks': '**996**VOSA STATES 17K  SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5d774304-e6d3-476f-9b7c-62f0023aecc7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-11-27 19:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be53543-7ba4-5140-8751-59dbe1e7fe4f with identifier: 117042418
2025-11-27 19:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be53543-7ba4-5140-8751-59dbe1e7fe4f with scrape type 2
2025-11-27 19:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3be53543-7ba4-5140-8751-59dbe1e7fe4f with scrape type 2
2025-11-27 19:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3be53543-7ba4-5140-8751-59dbe1e7fe4f, identifier: 117042418
2025-11-27 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/f394dffd-8bc4-4307-9786-13c332760711_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Fdc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/dc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3be53543-7ba4-5140-8751-59dbe1e7fe4f with identifier: 117042418
2025-11-27 19:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3be53543-7ba4-5140-8751-59dbe1e7fe4f with identifier: 117042418
2025-11-27 19:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3be53543-7ba4-5140-8751-59dbe1e7fe4f with identifier: 117042418 to the API
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117042418?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '3be53543-7ba4-5140-8751-59dbe1e7fe4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ72HTY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117042418',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CITROEN',
 'model': 'C4 HATCHBACK',
 'odometer': 18509,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Zenith',
 'title': 'CITROEN C4 HATCHBACK 1.2 PureTech [130] C-Series Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech [130] C-Series Edition 5dr',
 'vin': None,
 'year': 2022}
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117042418%27 HTTP/1.1" 200 None
2025-11-27 19:07:33 [astonbarclay.gb] INFO: Saving data for 117042418: {'auction_closing_time': 1764323100.0, 'created_time': 1763492838.498889, 'last_price_update_time': 1764270453.364528}
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117042418') HTTP/1.1" 204 0
2025-11-27 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252Fb7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac2b10>
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9e8410>
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eac1b10>
2025-11-27 19:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e9e9cd0>
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_0.jpg HTTP/1.1" 201 0
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252Fee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e952e50>
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252Fb5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea51f90>
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252Fd0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea28c90>
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Ff394dffd-8bc4-4307-9786-13c332760711_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/f394dffd-8bc4-4307-9786-13c332760711_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ebe36d0>
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_1.jpg HTTP/1.1" 201 0
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252Fdf9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eca3550>
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea85350>
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb0e450>
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_2.jpg HTTP/1.1" 201 0
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe9a810>
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD72TFA/2025-11-26/image/dc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366081?view=catalogue)
2025-11-27 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252Fd2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d3869d0>
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252Fddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd0f890>
2025-11-27 19:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_3.jpg HTTP/1.1" 201 0
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fd42910>
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252F8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ec25c50>
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-11-27 19:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600 not downloaded yet
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb62490>
2025-11-27 19:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb4b1d0>
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116824054?view=catalogue)
2025-11-27 19:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117490150?view=catalogue)
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8eb625d0>
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_9.jpg HTTP/1.1" 201 0
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD72TFA%252F2025-11-26%252Fimage%252Fdc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD72TFA/2025-11-26/image/dc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d
2025-11-27 19:07:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d, skipping ID generation
2025-11-27 19:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d with scrape type 1
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d from tracking dictionaries
2025-11-27 19:07:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d sending to next pipeline
2025-11-27 19:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d, identifier: 117366081
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8feeb050>
2025-11-27 19:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_4.jpg HTTP/1.1" 201 0
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d with identifier: 117366081
2025-11-27 19:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d with identifier: 117366081
2025-11-27 19:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d with identifier: 117366081 to the API
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-11-27 19:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SD72TFA/2025-11-26/image/dc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SD72TFA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117366081',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL Y HATCHBACK',
 'odometer': 31868,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 18879,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/a94030e3-d109-43bb-8049-21e9d9a37ac0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 18634,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/7c9ba55c-acb3-43a8-b797-09f25ac61899_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20786,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/aa5fad81-6c13-4291-b6a8-46697c12f550_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20780,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/b987ebc0-48e1-4a7e-beca-9ce0ebcebc06_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30175,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/4bf38b56-c14b-4055-bceb-02640c92c996_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32152,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/5c7a00af-7fe4-4511-a12d-2c303d077d62_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28981,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/f394dffd-8bc4-4307-9786-13c332760711_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37377,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/49d454fb-1ffc-44dc-a17b-c054bb06472a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37237,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/8339f16a-0bf0-46a8-b668-7ecb1c709d75_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d/aa67168a-4bd9-55c4-a488-dfb0cf0cfd3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39546,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/SD72TFA/2025-11-26/image/dc22595c-3ff4-4943-81f2-b83573bd76ad_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL Y HATCHBACK RWD 5dr Auto',
 'transmission': 'automatic',
 'trim': 'RWD 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366081%27 HTTP/1.1" 200 None
2025-11-27 19:07:39 [astonbarclay.gb] INFO: Saving data for 117366081: {'created_time': 1764270459.500677, 'last_price_update_time': 1764270459.500687, 'auction_closing_time': 1764323100.0}
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117366081') HTTP/1.1" 204 0
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea07bd0>
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252Fb7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8e80f8d0>
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ea6a0d0>
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_5.jpg HTTP/1.1" 201 0
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8ecf3bd0>
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNU72BDX%252F2025-11-20%252Fimage%252F298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb474c2f-8360-5cd9-9c59-afa5c40d0222
2025-11-27 19:07:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb474c2f-8360-5cd9-9c59-afa5c40d0222, skipping ID generation
2025-11-27 19:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb474c2f-8360-5cd9-9c59-afa5c40d0222 with scrape type 1
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bb474c2f-8360-5cd9-9c59-afa5c40d0222 from tracking dictionaries
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb474c2f-8360-5cd9-9c59-afa5c40d0222 sending to next pipeline
2025-11-27 19:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bb474c2f-8360-5cd9-9c59-afa5c40d0222, identifier: 116824054
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fee9350>
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYE71CXZ%252F2025-11-25%252Fimage%252F991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5695cd03-d320-5f17-8c6c-374dd45f343e
2025-11-27 19:07:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5695cd03-d320-5f17-8c6c-374dd45f343e, skipping ID generation
2025-11-27 19:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5695cd03-d320-5f17-8c6c-374dd45f343e with scrape type 1
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5695cd03-d320-5f17-8c6c-374dd45f343e from tracking dictionaries
2025-11-27 19:07:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5695cd03-d320-5f17-8c6c-374dd45f343e sending to next pipeline
2025-11-27 19:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5695cd03-d320-5f17-8c6c-374dd45f343e, identifier: 117490150
2025-11-27 19:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bb474c2f-8360-5cd9-9c59-afa5c40d0222 with identifier: 116824054
2025-11-27 19:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bb474c2f-8360-5cd9-9c59-afa5c40d0222 with identifier: 116824054
2025-11-27 19:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg5 electric estate 115kw excite ev 61kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg5 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10779, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116824054', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '115kw excite ev 61kwh 5dr auto', 'license_plate': 'nu72bdx', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': None, 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'bb474c2f-8360-5cd9-9c59-afa5c40d0222', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34498}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34393}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62631}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56678}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 64683}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51903}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mg motor uk mg5 electric estate', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 17347} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': None,
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'bb474c2f-8360-5cd9-9c59-afa5c40d0222',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nu72bdx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116824054',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg5 electric estate',
     'model': 'mg5 electric estate',
     'odometer': 10779,
     'odometer_in_km': 17347,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34498,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34531,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34393,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35128,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45138,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62631,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56678,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64683,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51903,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-10',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg5 electric estate 115kw excite ev 61kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '115kw excite ev 61kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-11-27 19:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: bb474c2f-8360-5cd9-9c59-afa5c40d0222 spider: astonbarclay.gb
2025-11-27 19:07:41 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: bb474c2f-8360-5cd9-9c59-afa5c40d0222 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mg motor uk mg5 electric estate 115kw excite ev 61kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mg motor uk', 'model': 'mg5 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 10779, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-10', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116824054', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '115kw excite ev 61kwh 5dr auto', 'license_plate': 'nu72bdx', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': None, 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'bb474c2f-8360-5cd9-9c59-afa5c40d0222', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34498}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34393}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 62631}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 56678}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 64683}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51903}], 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mg motor uk mg5 electric estate', 'sanitized_make': 'mgmotoruk', 'odometer_in_km': 17347} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': None,
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': 'bb474c2f-8360-5cd9-9c59-afa5c40d0222',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nu72bdx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116824054',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mg motor uk',
     'make_model': 'mg motor uk mg5 electric estate',
     'model': 'mg5 electric estate',
     'odometer': 10779,
     'odometer_in_km': 17347,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34498,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34531,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34393,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35128,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45138,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62631,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56678,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64683,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51903,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-10',
     'sanitized_make': 'mgmotoruk',
     'seller_name': 'zenith',
     'title': 'mg motor uk mg5 electric estate 115kw excite ev 61kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '115kw excite ev 61kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'bb474c2f-8360-5cd9-9c59-afa5c40d0222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NU72BDX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116824054',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MG MOTOR UK',
 'model': 'MG5 ELECTRIC ESTATE',
 'odometer': 10779,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34498,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/7ceeb82d-00ef-40db-b067-4c67e053b6b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34531,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/48a89819-70c9-4499-9a31-550eb96c4540_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34393,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/8d154759-e8d3-4754-979a-dffc786f511a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35128,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/b5568c45-2ffe-4c1e-b6e0-5d7bd14d687e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45138,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1e5fe40f-766a-419f-bf15-6f7a608d5322_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62631,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/ddedfea9-b6e0-42a9-bded-3719efa1eafb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56678,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/267dd827-0473-4150-9a37-2cfa30f64ad3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64683,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/1b3fe4a9-5eff-4764-ac1a-a3b35ee197bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb474c2f-8360-5cd9-9c59-afa5c40d0222/bb474c2f-8360-5cd9-9c59-afa5c40d0222_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51903,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NU72BDX/2025-11-20/image/298cffb7-233c-406a-bbab-6a617d79da1f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-10',
 'seller_name': 'Zenith',
 'title': 'MG MOTOR UK MG5 ELECTRIC ESTATE 115kW Excite EV 61kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '115kW Excite EV 61kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116824054%27 HTTP/1.1" 200 None
2025-11-27 19:07:41 [astonbarclay.gb] INFO: Saving data for 116824054: {'created_time': 1764270461.257779, 'last_price_update_time': 1764270461.25779, 'auction_closing_time': 1764323100.0}
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116824054') HTTP/1.1" 204 0
2025-11-27 19:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5695cd03-d320-5f17-8c6c-374dd45f343e with identifier: 117490150
2025-11-27 19:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5695cd03-d320-5f17-8c6c-374dd45f343e with identifier: 117490150
2025-11-27 19:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 60122, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117490150', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s]', 'license_plate': 'ye71cxz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '5695cd03-d320-5f17-8c6c-374dd45f343e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30770}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32683}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47740}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 67702}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47557}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50724}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 96756} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '5695cd03-d320-5f17-8c6c-374dd45f343e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ye71cxz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117490150',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 60122,
     'odometer_in_km': 96756,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30770,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32368,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32683,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34694,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67702,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47557,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41751,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50724,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s]',
     'vin': None,
     'year': 2021}
2025-11-27 19:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 5695cd03-d320-5f17-8c6c-374dd45f343e spider: astonbarclay.gb
2025-11-27 19:07:41 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5695cd03-d320-5f17-8c6c-374dd45f343e due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 60122, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117490150', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw 40 82kwh s line 5dr auto [c+s]', 'license_plate': 'ye71cxz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '5695cd03-d320-5f17-8c6c-374dd45f343e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30770}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32683}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47740}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 67702}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 47557}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50724}], 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'audi q4 e-tron estate', 'sanitized_make': 'audi', 'odometer_in_km': 96756} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '5695cd03-d320-5f17-8c6c-374dd45f343e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ye71cxz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117490150',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron estate',
     'model': 'q4 e-tron estate',
     'odometer': 60122,
     'odometer_in_km': 96756,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30770,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32368,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32683,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34694,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47740,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67702,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47557,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41751,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50724,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-26',
     'sanitized_make': 'audi',
     'seller_name': 'zenith',
     'title': 'audi q4 e-tron estate 150kw 40 82kwh s line 5dr auto [c+s]',
     'transmission': 'automatic',
     'trim': '150kw 40 82kwh s line 5dr auto [c+s]',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '5695cd03-d320-5f17-8c6c-374dd45f343e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE71CXZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117490150',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q4 E-TRON ESTATE',
 'odometer': 60122,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30770,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f5f5113-808e-48aa-a70f-ac4fcac3752b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32368,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/34dd4121-5f4a-4faf-88cf-70bbed7047d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32683,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/501d5db8-c954-4371-8200-cf1ef1ef1d09_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34694,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/d0d804d9-338c-4505-944d-0b4f7d33c6aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47740,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/9f0b398c-015a-41b9-9e2d-99baaf26aaad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67702,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/40ab41b8-39dd-4e2c-9460-a1422040bf16_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47557,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/1cfe3d01-a027-4acd-86a4-4eadf3504c0e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41751,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/b7445677-f4e6-41e1-8c7b-62c79f56e0c4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5695cd03-d320-5f17-8c6c-374dd45f343e/5695cd03-d320-5f17-8c6c-374dd45f343e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50724,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YE71CXZ/2025-11-25/image/991cbb73-604f-46dd-86c5-5acf89b59f05_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seller_name': 'Zenith',
 'title': 'AUDI Q4 E-TRON ESTATE 150kW 40 82kWh S Line 5dr Auto [C+S]',
 'transmission': 'automatic',
 'trim': '150kW 40 82kWh S Line 5dr Auto [C+S]',
 'vin': None,
 'year': 2021}
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117490150%27 HTTP/1.1" 200 None
2025-11-27 19:07:41 [astonbarclay.gb] INFO: Saving data for 117490150: {'created_time': 1764270461.503029, 'last_price_update_time': 1764270461.50304, 'auction_closing_time': 1764323100.0}
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117490150') HTTP/1.1" 204 0
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd9d36c350>
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_6.jpg HTTP/1.1" 201 0
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117405738?view=catalogue)
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efda14353d0>
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_7.jpg HTTP/1.1" 201 0
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252Fd2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-11-27 19:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-11-27 19:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-11-27 19:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7efd8fe6e590>
2025-11-27 19:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-11-27 19:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_8.jpg HTTP/1.1" 201 0
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGV23FSZ%252F2025-11-26%252Fimage%252F65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-11-27 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600 saved to cache
2025-11-27 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 919c451d-adc1-50d1-9d85-410cab300e8c
2025-11-27 19:07:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 919c451d-adc1-50d1-9d85-410cab300e8c, skipping ID generation
2025-11-27 19:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 919c451d-adc1-50d1-9d85-410cab300e8c with scrape type 1
2025-11-27 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 919c451d-adc1-50d1-9d85-410cab300e8c from tracking dictionaries
2025-11-27 19:07:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 919c451d-adc1-50d1-9d85-410cab300e8c sending to next pipeline
2025-11-27 19:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 919c451d-adc1-50d1-9d85-410cab300e8c, identifier: 117405738
2025-11-27 19:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 919c451d-adc1-50d1-9d85-410cab300e8c with identifier: 117405738
2025-11-27 19:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 919c451d-adc1-50d1-9d85-410cab300e8c with identifier: 117405738
2025-11-27 19:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4559, 'odometer_reading_unit': 'mi', 'registration_date': '2023-06-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405738', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'license_plate': 'gv23fsz', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '919c451d-adc1-50d1-9d85-410cab300e8c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36587}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38250}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38941}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39481}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50149}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57429}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48540}], 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 7336} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '919c451d-adc1-50d1-9d85-410cab300e8c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gv23fsz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405738',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 4559,
     'odometer_in_km': 7336,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36587,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38250,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38941,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39481,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50149,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57429,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46962,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57967,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48540,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-06-05',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto',
     'vin': None,
     'year': 2023}
2025-11-27 19:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 919c451d-adc1-50d1-9d85-410cab300e8c spider: astonbarclay.gb
2025-11-27 19:07:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 919c451d-adc1-50d1-9d85-410cab300e8c due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 9, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqa hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4559, 'odometer_reading_unit': 'mi', 'registration_date': '2023-06-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405738', 'expiration_date': '2025-11-28t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto', 'license_plate': 'gv23fsz', 'year': 2023, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '919c451d-adc1-50d1-9d85-410cab300e8c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36587}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38250}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38941}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 39481}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50149}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57429}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48540}], 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'mercedes-benz eqa hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 7336} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-11-28t09:45:00z',
     'fuel_type': 'electric',
     'id': '919c451d-adc1-50d1-9d85-410cab300e8c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gv23fsz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405738',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqa hatchback',
     'model': 'eqa hatchback',
     'odometer': 4559,
     'odometer_in_km': 7336,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 9,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36587,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38250,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38941,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39481,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50149,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57429,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46962,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57967,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48540,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-06-05',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'zenith',
     'title': 'mercedes-benz eqa hatchback eqa 250+ 140kw amg line 70.5kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': 'eqa 250+ 140kw amg line 70.5kwh 5dr auto',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-11-28T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '919c451d-adc1-50d1-9d85-410cab300e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GV23FSZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117405738',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'EQA HATCHBACK',
 'odometer': 4559,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36587,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/ee2ca0ea-f656-41cf-a9f9-63085e0995a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38250,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/df9855a7-3c4b-4bcc-8333-5c103348c765_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38941,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/1673e872-6d24-4a1e-ac14-6f4cec2a2bc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39481,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/0edd0f40-9289-4177-9fbc-ceae73709c9e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50149,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/5dfaf147-d559-4b39-8f85-619c55e4be35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57429,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/73d3d6f0-681e-4d0b-abc2-f7fc465ac525_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46962,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/61536881-de30-4241-9b00-b5f9db349e31_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57967,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/d2cdbbcf-0d6c-47d3-8086-7e716b7a1d07_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_919c451d-adc1-50d1-9d85-410cab300e8c/919c451d-adc1-50d1-9d85-410cab300e8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48540,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GV23FSZ/2025-11-26/image/65c4036e-c07a-4c40-b4b6-e58745da8aec_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-05',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ EQA HATCHBACK EQA 250+ 140kW AMG Line 70.5kWh 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'EQA 250+ 140kW AMG Line 70.5kWh 5dr Auto',
 'vin': None,
 'year': 2023}
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405738%27 HTTP/1.1" 200 None
2025-11-27 19:07:42 [astonbarclay.gb] INFO: Saving data for 117405738: {'created_time': 1764270462.530952, 'last_price_update_time': 1764270462.53096, 'auction_closing_time': 1764323100.0}
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117405738') HTTP/1.1" 204 0
2025-11-27 19:07:42 [scrapy.core.engine] INFO: Closing spider (finished)
2025-11-27 19:07:42 [astonbarclay.gb] INFO: astonbarclay.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 8, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2}
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-11-27 19:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20last_price_update_time%20lt%201763838462 HTTP/1.1" 200 None
2025-11-27 19:07:42 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (250 items) in: file:///var/lib/scrapyd/items/sourcing_v2/astonbarclay.gb/task_36_2025-11-27T19_00_00.jl
2025-11-27 19:07:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 744409,
 'downloader/request_count': 1253,
 'downloader/request_method_count/GET': 1253,
 'downloader/response_bytes': 43103704,
 'downloader/response_count': 1253,
 'downloader/response_status_count/200': 1253,
 'elapsed_time_seconds': 458.024551,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 11, 27, 19, 7, 42, 780004, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 74,
 'item_dropped_reasons_count/DropItem': 74,
 'item_scraped_count': 250,
 'log_count/DEBUG': 14154,
 'log_count/ERROR': 93,
 'log_count/INFO': 13821,
 'memusage/max': 185036800,
 'memusage/startup': 127340544,
 'photo_download_count': 927,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 78,
 'playwright/request_count/aborted': 42,
 'playwright/request_count/method/GET': 55,
 'playwright/request_count/method/HEAD': 12,
 'playwright/request_count/method/POST': 11,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 22,
 'playwright/request_count/resource_type/font': 2,
 'playwright/request_count/resource_type/image': 30,
 'playwright/request_count/resource_type/script': 7,
 'playwright/request_count/resource_type/stylesheet': 2,
 'playwright/request_count/resource_type/xhr': 13,
 'playwright/response_count': 36,
 'playwright/response_count/method/GET': 25,
 'playwright/response_count/method/POST': 11,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 2,
 'playwright/response_count/resource_type/script': 7,
 'playwright/response_count/resource_type/stylesheet': 2,
 'playwright/response_count/resource_type/xhr': 13,
 'request_depth_max': 3,
 'response_received_count': 326,
 'scheduler/dequeued': 1253,
 'scheduler/dequeued/memory': 1253,
 'scheduler/enqueued': 1253,
 'scheduler/enqueued/memory': 1253,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 325,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 6.986990277565336,
 'scrapy-zyte-api/mean_response_seconds': 6.988219958309334,
 'scrapy-zyte-api/processed': 325,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 325,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 324,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 325,
 'scrapy-zyte-api/request_args/httpResponseBody': 325,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 325,
 'scrapy-zyte-api/request_args/url': 325,
 'scrapy-zyte-api/status_codes/200': 325,
 'scrapy-zyte-api/success': 325,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 11, 27, 19, 0, 4, 755453, tzinfo=datetime.timezone.utc)}
2025-11-27 19:07:42 [scrapy.core.engine] INFO: Spider closed (finished)